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For  an  almost  surely  (a.s.)  convergent  series  of  random  variables  5'„  =  53"=!  Xj, 

the  tail  series  r„  =  J2%n  ^i  is  a  well-defined  sequence  of  random  variables  which 

converges  to  0  a.s.   The  rate  of  a.s.   convergence  of  5„  to  a  random  variable  5*  is 

investigated  through  the  current  study  of  the  rate  in  which  r„  converges  to  0  a.s. 

Tail  series  strong  laws  of  large  numbers  (SLLN)  of  the  form  b-^T^  -^  0  a.s.  (where 

{6„,  n  >  1}  is  a  sequence  of  positive  constants  with  5„  J.  0)  are  obtained  under 

various  sets  of  conditions.  Both  the  cases  of  (i)  {X„,  n  >  1}  having  no  conditions 

on  their  joint  distributions  and  (ii)  {X„,  n  >  1}  being  independent  are  investigated. 

Some  earlier  work  by  Klesov  on  the  tail  series  SLLN  problem,  which  had  provided 

tail  series  analogues  of  Petrov's  SLLNs  for  partial  sums,  is  generalized  to  a  larger 

class  of  random  variables.   In  the  case  of  independent  summands,  some  tail  series 


analogues  of  Teicher's  SLLNs  for  partial  sums  are  obtained  as  well. 

Moreover,  by  employing  the  von  Bahr  and  Esseen  inequality,  tail  series  weak  laws 
of  large  numbers  (WLLN)  for  independent  random  variables  are  obtained.  The  tail 
series  WLLNs  provide  a  bound  on  the  rate  in  which  sup_^>„  \Tj\  converges  to  0  in 
probability.  These  tail  series  WLLNs  are  compared  with  the  tail  series  SLLNs  and 
with  tail  series  laws  of  the  iterated  logarithm  of  Rosalsky. 

Examples  are  provided  throughout  to  illustrate  the  current  results  and  to  com- 
pare them  with  other  results  in  the  Hterature. 
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CHAPTER  1 
INTRODUCTION 


The  theory  of  partial  sums  of  random  variables  has  been  at  the  forefront  of 
research  in  statistical  science  for  most  of  this  century.  The  case  of  independent 
summands  has  been  of  especial  interest.  One  of  the  most  interesting  problems  in 
classical  probability  theory  has  been  to  determine,  for  a  given  series  of  random 
variables,  the  probability  that  the  series  converges.  (Here,  and  throughout  the 
entire  sequel,  the  term  "converges"  means  that  the  limit  under  consideration  exists 
and  is  finite.  The  term  "diverges"  means  "does  not  converge.")  According  to  the 
famous  Kolmogorov  0-1  law  (see,  e.g.,  Chow  and  Teicher  [14],  p.  64,  or  Chung  [17], 
p.  254),  a  series  of  independent  random  variables  either  converges  almost  surely 
(a.s.)  or  diverges  a.s.  The  primary  objective  of  the  current  work  is  to  determine 
the  almost  sure  rate  of  convergence  for  a  convergent  series.  This  objective  will  be 
discussed  in  more  detail  below. 
Let 

n 

Sn  =  '^Xj,  n  >  1, 
i=i 

where  {X„,  n  >  1}  are  random  variables.  This  dissertation  will  concentrate  on  a 
series  of  independent  random  variables,  but  some  results  are  obtained  without  as- 
suming independence.  To  establish  almost  sure  convergence  of  the  series  Sn  assum- 
ing {Xn,  n  >  1}  are  independent  random  variables,  the  Khintchine-Kolmogorov 

1 


convergence  theorem  (see,  e.g.,  Chow  and  Teicher  [14],  p.  110)  and  the  celebrated 
Kolmogorov  three-series  criterion  (see,  e.g..  Chow  and  Teicher  [14],  p.  114,  or  Chung 
[17],  p.  118)  are  very  useful  devices.  In  fact,  the  Kolmogorov  three-series  criterion 
provides  a  triumvirate  of  conditions  which  are  both  necessary  and  sufficient  for  the 
convergence  of  the  series  ^n  when  the  summands  {X„,  n  >  1}  are  independent 
random  variables. 

The  Khintchine-Kolmogorov  convergence  theorem  asserts  that  if  {Xn,  n  >  1} 
are  independent  random  variables  with 

oo 

E(X„)  =  0,  n  >  1  and  j;  E(X^)  <  oo, 

n=l 

then  the  series  5„  converges  a.s.    and  in  quadratic  mean  to  a  random  variable  S 
with 

cx> 
n=l 

The  Kolmogorov  three-series  criterion  asserts  that  if  {Xn,  n  >  1}  are  independent 
random  variables,  then  the  series  6'„  converges  a.s.  iff 


{i)EP{l^n|>l}<00, 
n=l 

oo 

(ii)  53^(^1^^)  converges, 

n=l 

(iii)i:Var(xW)<oo, 


n=l 


where 


X^^^  =  A'„I[|^„|<i],  n  >  1 


If  the  series  S,,  converges  a.s.  to  a  random  variable  S,  then  (set  Sq  =  Xq  =  0) 
the  tail  series 

oo 
Tn  =  S  —  Sn-1  =  ^Xj,    n  >  1 
j=n 

is  a  well-defined  sequence  of  random  variables  and  converges  to  0  a.s.  In  the  the- 
ory of  partial  sums,  the  fact  that  the  sum  Sn  is  well  defined  for  every  n  is,  of 
course,  automatic.  On  the  other  hand,  in  the  theory  of  tail  series,  the  problem  as 
to  whether  {r„,  n  >  1}  is  well  defined  is  a  genuine  one.  The  two  classical  the- 
orems (Khintchine-Kolmogorov  convergence  theorem  and  Kolmogorov  three-series 
criterion)  play  a  key  role  in  guaranteeing  that  the  tail  series  T„  is  well  defined  in 
the  case  of  independent  summands.  In  this  dissertation,  we  will  focus  on  the  rate 
of  convergence  of  the  series  Sn  to  a  random  variable  S  or,  equivalently,  on  the  rate 
of  convergence  of  the  tail  series  r„  to  0. 

We  say  that  the  sequence  of  random  variables  {Xn,  n  >  1}  (such  that  the  series 
Sn  diverges  a.s.)  obeys  the  strong  law  of  large  numbers  (SLLN)  with  norming 
constants  {a„,  n  >  1}  if 

>  0  a.s. 

where  {a„,  n  >  1}  is  a  sequence  of  positive  constants  with  a„  |  oo. 

In  the  same  way,  we  will  say  that  the  sequence  {X„,  n  >  1}  obeys  the  tail  series 
SLLNvfith.  norming  constants  {6„,  n  >  1}  if  the  tail  series  Tn  is  well  defined  and 

T 

>  0  a.s. 

On 

where  {6„,  n  >  1}  is  a  sequence  of  positive  constants  with  6„  |  0. 


Of  course,  a  SLLN  has  a  sharper  result  for  the  slower  0  <  a„  |  oo.  Similarly,  a 
tail  series  SLLN  has  a  sharper  result  for  the  faster  0  <  &„  i  0. 

SLLNs  for  partial  sums  lie  at  the  very  foundation  of  statistical  science  and 
have  been  and  still  are  the  subject  of  vigorous  research  activity.  In  the  case  of 
partial  sums,  the  SLLN  problem  was  investigated  prior  to  the  LIL  problem.  On  the 
other  hand,  the  situation  is  reversed  for  tail  series;  the  tail  series  LIL  problem  was 
investigated  prior  to  the  tail  series  SLLN  problem.  As  will  be  seen,  many  results 
for  partial  sums  Sn  can  be  paired  with  analogous  results  for  tail  series  T„.  (Of 
course,  the  actual  random  variables  in  the  series  Sn  and  tail  series  T„  are  necessarily 
different.)  This  duality  was  first  discovered  and  investigated  by  Chow  and  Teicher 
[13]. 

Chow  and  Teicher  [13]  constructed  a  milestone  for  research  about  the  rate  of 
almost  sure  convergence  of  the  tail  series  of  independent  random  variables.  They 
developed  a  tail  series  counterpart  to  the  renowned  Kolmogorov  law  of  the  iterated 
logarithm  (LIL)  (see,  e.g.,  Chow  and  Teicher  [14],  p.  343,  or  Petrov  [40],  p.  292)  for 
series  of  independent  and  bounded  random  variables.  Studies  to  eliminate  Chow 
and  Teicher's  boundedness  assumption  were  conducted  by  Barbour  [9],  Heyde  [23], 
Budianu  [12],  Rosalsky  [41],  and  Klesov  [29].  Barbour  [9]  suggested  a  methodology 
which  yields  a  tail  series  analogue  of  the  Linderberg- Feller  version  of  the  central  limit 
theorem  (CLT)  (see,  e.g..  Chow  and  Teicher  [14],  p.  291,  or  Loeve  [34],  p.  292). 
Using  this  methodology,  Heyde  [23]  obtained  tail  series  analogues  of  the  CLT  and 
LIL  for  a  martingale  difference  sequence.  Budianu  [12]  proved  a  tail  series  LIL  for 


series  of  independent  unbounded  random  variables,  which  is  a  tail  series  analogue 
of  Petrov  [40,  Section  10.2,  Theorems  2]  LIL,  and  extended  it  for  two-dimensional 
random  variables.  Rosalsky  [41]  developed  a  more  general  tail  series  LIL  than  that 
of  Budianu  [12]  for  series  of  independent  unbounded  random  variables,  which  is  a 
tail  series  counterpart  to  Teicher's  [45]  version  of  the  LIL,  and  as  special  cases  he 
proved  tail  series  LILs  for  weighted  sums  of  independent  and  identically  distributed 
(i.i.d.)  random  variables  (see  below  for  the  definition  of  the  weighted  i.i.d.  case). 
In  the  same  year  as  Rosalsky's  article  appeared,  Klesov  [29]  developed  a  version  of 
the  tail  series  LIL  for  weighted  i.i.d.  unbounded  random  variables,  but  Klesov's  [29, 
Proposition  4]  result  is  nothing  but  the  special  case  ^  =  0  of  Rosalsky  [41,  Theorem 
2].  Klesov  [29]  also  proved  two  tail  series  SLLNs  for  independent  random  variables, 
which  are  tail  series  analogues  of  Petrov  [40,  Section  9.3,  Theorems  12  and  13]  and 
Petrov  [38,  Theorem  5],  respectively. 

In  his  follow-up  article,  Klesov  [30]  extended  his  previous  tail  series  SLLNs  to 
wider  classes  of  independent  random  variables,  and  he  also  obtained  tail  series 
SLLNs  for  several  other  dependence  structures,  viz.  arbitrary  sequences  with  no 
assumptions  on  their  joint  distributions,  orthogonal  sequences,  quasistationary  se- 
quences, and  martingale  difference  sequences. 

Solntsev  [43]  proved  a  tail  series  SLLN,  but  his  result  is  not  satisfactory  since 
his  condition  involves  blocks 


n* 


of  summands  rather  than  individual  summands.  It  is  widely  discussed  in  the 


literature  (see,  e.g.,  Chung  [16]  or  Loeve  [34],  p.  270)  that  conditions  for  the  classical 
SLLN  for  partial  sums  which  involve  blocks  of  random  variables  (as  opposed  to  only 
the  individual  summands)  are  unsatisfactory  or  at  best  undesirable.  Such  criticism 
carries  over  directly  to  the  tail  series  situation. 

Throughout  the  entire  sequel,  all  random  variables  are  defined  on  a  fixed  but 
otherwise  arbitrary  probability  space  (0,  T^  P),  and  the  logarithm  and  iterated 
logarithm  are  conveniently  defined  for  x  >  0  and  a  positive  integer  r,  by 


'-^ 


■?* 


logi  X  =  ^ 


log  X,    if  X  >  e 
-  X,        if  X  <  e 
and 

log,  X  =  logj  log,_i  X,  r  >  2 

where  log  x  (when  x  >  e)  denotes  the  natural  logarithm. 

Some  of  the  results  herein  as  well  as  some  examples  illustrating  them  con- 
cern the  weighted  i.i.d.  case  consisting  of  sequences  {X„,  n  >  1}  of  the  form 
^n  —  OfiKu  n  >  1,  where  {K,  n  >  1}  are  i.i.d.  random  variables  with  E(Fi)  = 
0,  E  (Fj^)  =  1,  and  {on,  ^  ^  1}  are  nonzero  constants. 

This  dissertation  will  be  divided  into  five  chapters  which  will  now  be  briefly 
described.  In  Chapter  2,  we  will  generalize  some  of  Klesov's  [30]  tail  series  SLLNs. 
(Throughout  this  chapter  and  the  subsequent  ones,  our  assumptions  on  the  ran- 
dom variables  {X„,  n  >  1}  involve  the  individual  summands  rather  than  blocks 
of  summands  as  were  considered  by  Solntsev  [43].)  Furthermore,  we  will  develop 
truncated  versions  of  our  new  tail  series  SLLNs.  Both  of  the  cases 


'-        '5    .  V  ..  '■ 
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'      ■  *  '  ■■> 
(i)  {Xn,  n  >  1}  are  independent  random  variables,  ' 

and  ■  '  ■  '    '  .       .4i 

•  • } 
(ii)  {Xn,  n  >  1}  are  random  variables  with  no  assumptions  being  imposed 

on  their  joint  distributions 

are  investigated.   Also  we  will  provide  examples  which  demonstrate  that  the  new 

results  are  indeed  better  than  previous  ones. 

Chapter  3  is  quite  independent  of  the  others.  In  Chapter  3,  we  will  study  the 

rate  of  convergence  in  probability  of  a  series  5„  of  independent  random  variables  to 

a  random  variable  S  or,  more  specifically,  the  rate  in  which  sup  >„  \Tj\  converges 

to  0  in  probability  by  establishing  tail  series  weak  laws  of  large  numbers  (WLLN). 

These  tail  series  WLLNs  take  the  form 

sup|T,| 

On 

where  {6„,  ra  >  1}  is  a  sequence  of  norming  constants  with  0  <  fe„  J.  0.  As  special 
cases  of  our  tail  series  WLLNs,  we  will  obtain  the  tail  series  WLLNs  for  weighted 
sums  of  i.i.d.  random  variables.  Also,  via  the  example  of  the  harmonic  series  with 
a  random  choice  of  signs,  we  will  find  a  sequence  of  norming  constants  which  yields 
tail  series  WLLNs,  but  does  not  yield  tail  series  SLLNs. 

In  Chapter  4,  we  will  prove  advanced  tail  series  SLLNs  for  series  of  independent 
random  variables,  which  are  counterparts  to  Teicher's  [47]  SLLNs  for  partial  sums. 
As  special  cases  of  these  tail  series  SLLN'S,  we  will  investigate  the  tail  series  SLLN 
problem  for  weighted  sums  of  i.i.d.  random  variables.  Also  we  will  provide  an 
example  which  illustrates  the  new  results. 


8 

Finally,  in  the  last  chapter  (Chapter  5),  some  problems  for  future  research  work 
are  presented. 


\*  /^ 


CHAPTER  2 
TAIL  SERIES  STRONG  LAWS  OF  LARGE  NUMBERS  I 


2.1     Introduction  and  Preliminaries 

The  tail  series  LIL  has  comparatively  rich  references;  on  the  other  hand,  the 
tail  series  SLLN  has  limited  references.  Two  papers  of  Klesov  [29  and  30]  are 
good  references  of  the  tail  series  SLLN.  Although  Klesov  [29]  proved  two  tail  series 
SLLNs  for  independent  random  variables  by  first  establishing  a  tail  series  version 
of  the  Kolmogorov's  inequality  (see,  e.g.,  Chow  and  Teicher  [14],  p.  127  or  Petrov 
[40],  p.  52),  the  proof  of  his  tail  series  version  of  the  Kolmogorov's  inequality 
is  very  complicated,  and  we  could  not  quite  follow  his  argument.  His  argument 
rested  on  a  tail  series  inequality  which  he  did  not  substantiate.  But,  in  his  follow- 
up  article,  using  a  tail  series  analogue  of  the  Kronecker  lemma  (rather  than  his  tail 
series  version  of  the  Kolmogorov's  inequality),  Klesov  [30]  extended  his  previous  tail 
series  SLLNs  to  wider  classes  of  independent  random  variables.  He  also  developed 
tail  series  SLLNs  for  arbitrary  random  variables  (i.e.,  not  necessarily  independent) 
as  well. 

Some  of  Klesov's  [29,  30]  work  will  now  be  described.  Let  ^  be  the  class  of 
functions  ^(x)  satisfying  the  following  three  conditions: 

(i)  tl^{x)  is  positive  and  nondecreasing. 
9 


A'-.. 
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(ii)  a;V'(— )  tends  monotonically  to  0  as  x  |  0. 

X 

oo  2 

;^i«V'(n) 
Examples  of  such  functions  xl}{x)  are 

xl){x)  =  |i|",  0<a<  1 
V'(x)  =  (logi  |x|)^+%  £  >  0 

V'(x)  =  (logi    |x|)(log2    1x1)^+%    £>0 

and  so  on. 

For  arbitrary  random  variables  {X„,  n  >  1},  without  the  assumption  of  inde- 
pendence, Klesov  [30]  developed  two  tail  series  SLLNs  (Propositions  1  and  2  below). 
But  Proposition  2  included  a  technical  error  in  its  formulation,  and  so  it  needs  to 
be  restated.  As  in  Chapter  1,  {r„,  n  >  1}  denotes  throughout  the  sequence  of  tail 
series  Tn  =  ir^„  X,,  n  >  1,  corresponding  to  random  variables  {Xn,  n  >  1}.  Note 
that  the  hypotheses  of  Proposition  1  and  2  ensure  that  {Tn,  n  >  1}  is  well  defined. 

Proposition  1  (Klesov  [30]).  Let  0  <  p  <  I  and  let  {X„,  n  >  1}  ie  random 
variables.  Furthermore,  let  {6„,  n  >  1}  be  a  sequence  of  positive  constants  with 
6„  I  0.  If  the  series 


then  the  tail  series  SLLN 


2^ — LP —  <°°' 

n=l  "^ 


7 ^  0  a.s. 

On 


obtains. 


u 

Proposition  2  (Klesov  [30]).    Let  0  <  p  <  1  and  let  {Xn,  n  >  1}  6e  random 
variables.  If  the  series 

f;E(|x„n<c», 

n=l 

then  setting 

oo 

An  =  ^E{\Xjn,  n>l, 

j=n 

and  assuming  that  A„  >  0,  n>l,  the  tail  series  SLLN 

T 
j — >  0  a.s. 

obtains  for  each  function  rl){x)  6  ^. 

Proposition  2  is  a  tail  series  analogue  of  a  SLLN  of  Petrov  [39]. 

Under  the  assumption  that  {Xn,  n  >  1}  are  independent  random  variables, 
Propositions  1  and  2  have  been  extended  by  Klesov  [30]  to  Propositions  3  and  4 
below,  respectively,  by  employing  a  class  of  functions  instead  of  a  specific  function 
g{x)  =  |a;|'',  0  <  p  <  1.  But  both  of  them  included  a  technical  error  in  their 
formulation,  and  so  they  need  to  be  reformulated  as  follows.  In  addition,  Klesov 
[30]  did  not  verify  that  his  conditions  ensure  that  the  tail  series  {r„,n  >  1}  is 
indeed  well  defined. 

Let  the  function  g{x)  be  positive  for  x  >  0  with  g{x)  t  cx3  as  x  t  oo.  Assume 
that  either  of  the  following  two  conditions  holds 

(i)  — — r  is  nondecreasing  for  x  >  0. 

q(x]  X 

(ii)  is  nondecreasing  for  x  >  0,  — r--  is  nondecreasing  for  x  >  0, 

^  gix) 

andE(X„)  =  0,  n  >  1. 


■4'^i\ 
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Proposition  3  (Klesov  [30]).  Let  {X„,  n  >  1}  be  independent  random  variables 
and  let  {6„,  n  >  1}  be  a  sequence  of  positive  constants  with  bn  i  0.  If  the  series 

^1       9{K) 


then  the  tail  series  SLLN 


T 

7 >  0  a.s. 

On 


obtains. 

Proposition  4  (Klesov  [30]).  Let  {X„,  n  >  1}  k  independent  random  variables. 
If  the  series 

oo 

^E(^(|X„|))<cx),  (2.1.1) 

n=l 

</ie7i  setting 

oo 

^n  =  EE(5(l^il)),  n>l 

i=n 

and  assuming  that  An>Q,  n>\,  the  tail  series  SLLN 

7 r — >  0  a.s. 

obtains  for  each  function  ip{x)  £  ^. 

Not  only  do  Propositions  3  and  4  reduce  to  two  tail  series  SLLNs  of  Klesov 
[29],  respectively,  by  taking  g{x)  =  |z|p,  0  <  p  <  2,  but  they  also  are  tail  series 
analogues  of  Petrov  [40,  Section  9.  3,  Theorem  11  with  gn  =  9,  n  >  1]  and  Petrov 
[38,  Theorem  5],  respectively. 

Most  of  our  results  in  this  chapter  are  based  on  the  following  two  lemmas. 

Lemma  1  (Heyde  [23],  Rx)salsky  [41],  Klesov  [30]).  Let  {x„,  n  >  1}  be  a  sequence 
of  constants  and  let  {bn,  n  >  1}  be  a  sequence  of  positive  constants  with  bn  J.  0.  // 


m 

the  series 

V]  Y~  converges, 


then 


1    °° 


Lemma  1  is  a  tail  series  analogue  of  the  Kronecker  lemma.  This  lemma  is  initially 
due  to  Heyde  [23],  but  Rosalsky  [41]  re-proved  it  in  an  alternative  way  because 
Heyde's  original  proof  was  not  clear.  One  year  after  Rosalsky's  [41]  paper  appeared, 
but  independently  from  Rosalsky's  paper,  Klesov  [30]  proved  the  lemma  in  a  manner 
similar  to  that  of  Rosalsky.  As  we  mentioned  earlier,  in  his  previous  paper,  Klesov 
[29]  proved  his  tail  series  SLLNs  via  a  tail  series  version  of  the  Kolmogorov  inequality 
instead  of  the  above  tail  series  analogue  of  the  Kronecker  lemma.  The  approach 
using  this  analogue  of  the  Kronecker  lemma  is  simpler  and  indeed  more  natural. 

Lemma  2  (Klesov  [29]).  Let  {c„,  n>l}  be  a  sequence  of  nonnegative  constants 
such  that  E^i  Cn  <  oo.  If 


C„  =  X^Cj  >0,  n>  1, 

j=n 

then 

obtains  for  each  function  xl^{x)  G  ^. 

This  lemma  is  a  tail  series  analogue  of  the  Abel-Dini  theorem  (see,  e.g.,  Knopp 
[32],  p.  290). 


'M'. 


■'^■: 
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2.2     Tail  series  SLLNs  for  Arbitrary  Random  Variables 


For  arbitrary  random  variables  {Xn,  n  >  1},  without  the  assumption  of  inde- 
pendence, we  obtain  the  following  tail  series  SLLNs.  To  avoid  trivial  considerations, 
assume  that  {Xn,  n  >  1}  are  not  eventually  degenerate  at  0.  This  assumption  is 
in  effect  throughout  the  entire  chapter  and  will  not  be  repeated.  The  main  result 
of  this  section.  Theorem  1,  may  now  be  stated.  It  will  be  shown  in  the  proof  of 
Theorem  1  that  the  hypotheses  ensure  that  {Tn,n  >  1}  is  a  well-defined  sequence 
of  random  variables.  The  proof  of  Theorem  1  will  be  deferred  until  after  the  proof 
of  the  ensuing  Lemma  4. 

Theorem  1.  Let  {X„,  n  >  1}  6e  random  variables  and  let  {gn{x),  n  >  1}  6e 
strictly  increasing  functions  defined  on  [0,  oo)  such  that 


9n{0)  =  0  and   lim  5„(a:)  =  oo,  n  >  1. 


(2.2.1) 


Assume  that 


9nix) 


is  nondecreasing  as  0  <  x  "f  for  each  n  >  1 


(2.2.2) 


and 


gn{x)  is  nondecreasing  in  n  for  each  fixed  x  >  0. 


(2.2.3) 


If  the  series 


then  setting 


oo 

^E{gn{\Xn\))<oo, 


n=l 


A.  =  I;e(^,(|X,|)),  n>l 


j=n 


(2.2.4) 
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and  assuming  that  for  some  function  ^'(a;)  €  ^ 

P  {\Xr,\  <  g-'  (a  H^-'))  eventually  }  =  1,  (2.2.5) 

the  tail  series  SLLN 

T 

0  a.s.  (2.2.6) 


5n^(XV'(A-^)) 
obtains,  where  g~^  denotes  the  inverse  function  of  gn  for  each  n  >  1. 

Remarks,  (i)  By  the  Borel-Cantelli  lemma,  a  sufficient  condition  for  (2.2.5)  is 

oo 

EP{l^n|>5„-^(AV'M;'))}<00. 
n=l 

(ii)  From  the  definitions  of  An  and  the  class  ^,  we  note  that  An  rp{A~^)  i  and 
so  g~^\^Anip{A~'^))  I.  Moreover,  the  condition  (2.2.5)  is  necessary  for  (2.2.6)  to 
hold.  This  follows  from  the  remark  after  the  ensuing  Lemma  4  by  setting  6„  = 
g-'{Antk{A-')),n>h 

(iii)  For  each  n  >  1,  note  that  (2.2.2)  together  with  the  fact  that  each  gn{x)  is  a 
nondecreasing  function,  implies  that  each  gn{x)  is  necessarily  a  continuous  function. 
In  order  to  prove  this,  we  will  show  that 

9n{xo)  =  gni^o)  for  arbitrary  xq  £  (0,  oo)  and  for  each  n  >  1.  (2.2.7) 

Let  0  <  5  <  xo  <  ^.  Then  (2.2.2)  ensures  that 

S  Xq  t 

—  — 7 — \  —  — rT>  '^  ^  I- 


9n{s)         gn{Xo)         gnit) 

Take  s  1  xq  and  1 1  Xq.  Then 


— T-— -  =  Iim  — ;-^  <  lim  — 77"  =  — ;— 7— ,  n  >  1. 
9n[Xo)       sUo  gn(s)       H^o  gn{t)       5f„(Xo) 


u 

Therefore,  gn{xo)  >  gni^o)  for  arbitrary  xoe(0, cxd)  and  for  each  n  >  1.  Hence, 
via  the  monotonicity  of  each  gn,  (2.2.7)  follows.  □ 

Assuming  (2.2.5)  (which  is  necessary  for  (2.2.6)),  then  not  only  does  Theorem 
1  reduce  to  Proposition  2  by  setting 

^„(x)  =  |x|P,  0<p<l,  n>l, 

but.  Theorem  1  also  yields  Theorem  2  under  the  condition  (t),  without  the  inde- 
pendence assumption. 

The  proof  of  Theorem  1  utilizes  the  following  two  lemmas. 

Lemma  3.  Let  {X„,  n  >  1}  6e  random  variables  and  let  {gn{x),  n  >  1}  be  non- 
decreasing  functions  defined  on  [0,  oo)  satisfying  (2.2.1)  and  (2.2.2).  Furthermore, 
let  {bn,  n  >  I]  be  a  sequence  of  positive  constants  such  that 


P  {\Xn\  <  bn  eventually  }  =  1. 


(2.2.8) 


If  the  series 


then  the  series 


^  e(5„(|X„|)) 

^1  9n{bn) 


oo     v 

-7—  converges  a.s. 
n=l   "n 


(2.2.9) 


(2.2.10) 


Remark.  Since  (2.2.10)  ensures  that  b-^Xn  -^  0  a.s.,  (2.2.8)  follows.  Thus  the 
condition  (2.2.8)  is  necessary  for  (2.2.10)  to  hold. 

Proof  of  Lemma  3.  By  (2.2.8),  for  almost  all  a;  €  fi  there  exists  an  integer  N(uj) 
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such  that  \Xn{u})\  <  6„  for  all  n  >  N{u),  and  hence  by  (2.2.2) 

'f;^;^'      <  -^,  n  >  Niu).  (2.2.11) 

Next,  via  the  Lebesgue  monotone  convergence  theorem,  (2.2.9)  ensures  that 

and  so 

t  ^^  <  -  a.s.  (2.2.12) 

n=l     yn\"n) 

Thus,  for  almost  all  w  G  ft 

g  l^n(a;)|     ^    ^^  |^n(u^)|   ,       g>       |X„(a;)| 

n=l         ""  n=l  °"  n=Ar(w)+l  ^" 


<    oo  (by  (2.2.12)) 


<    E^f^+     E     ^^^™^  (by  (2.2.11)) 


and  therefore  (2.2.10)  obtains.  □ 

Using  Lemmas  1  and  3,  we  obtain  the  following  lemma. 

Lemma  4.  Let  {X„,  n  >  1}  6e  random  variables  and  let  {gn(x),  n  >  1}  be  non- 
decreasing  functions  defined  on  [0,  oo)  satisfying  (2.2.1)  and  (2.2.2).  Let  {6„,  n  >  1} 
be  a  sequence  of  positive  constants  satisfying  (2.2.8)  with  6„  J.  0.  If  gn{bn)  =  0(1) 
and  (2.2.9)  holds,  then  the  tail  series  SLLN 

T 

T^  -^  0  a.s.  (2.2.13) 

obtains. 
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Remark.  The  triangle  inequality  and  the  fact  that  fe„  J.  imply 

On  On  0„+i 

and  so  (2.2.13)  ensures  b~^Xn  —*  0  a.s.  Thus  the  condition  (2.2.8)  is  necessary  for 
(2.2.13)  to  hold. 

Proof  of  Lemma  4.  Note  that  (2.2.9)  and  </„(&„)  =  0(1)  ensure  (2.2.4)  which,  as 
will  be  demonstrated  in  the  proof  of  Theorem  1,  ensures  that  {Tn,n  >  1}  is  well 
defined.  Employing  Lemma  3  yields  (2.2.10).  Since  6„  |  0,  the  lemma  follows  from 
Lemma  1.  □ 

By  assuming  (2.2.8)  which  is  a  necessary  condition  for  (2.2.10)  and  (2.2.13), 
Lemmas  3  and  4  yield  the  ensuing  Lemmas  5  and  6,  respectively,  but  without 
assuming  independence  in  the  case  when  the  condition  (i)  of  Theorem  2  is  assumed. 
Also  Lemma  4  reduces  to  Proposition  1  by  setting 

g„{x)  =  Ixl",  0  <  p  <  1,  n  >  1. 

The  proof  of  Theorem  1  may  now  be  given. 

Proof  of  Theorem  1 .  Firstly,  we  want  to  show  that  the  tail  series  {Tn,n  >  1} 
is  well  defined.    Since,  via  the  Lebesgue  monotone  convergence  theorem,  (2.2.4) 


ensures 


'(iZi'nd^n 
\n=l 


E     Ei'nd^nl)       <0O, 


(2.2.4)    =^    5;5„(|X„|)<ooa.s.  (2.2.14) 

n=l 
=^     gn{\Xn\)  -^  0  a.s. 

=^    \Xn\  -^  0  a.s.    (by  (2.2.3)).  (2.2.15) 


Vt"'  - 


"vT"? 


Now  let  N{ui)  be  the  random  integer  defined  by 

iV(c<;)  =  min  {A'^  >  1  :  |A'„(a;)|  <  1  for  all  n>  N]  (=  oo,  otherwise  ). 
Then  (2.2.15)  ensures  that  N{u)  <  oo  a.s.  whence  by  (2.2.2),  for  almost  all  a;  G  fi 

-^  <  -^,  n  >  7V(u;).  (2.2.16) 

9n{\Xn\)  <7„(1) 

Thus,  for  almost  all  a;  €  fi 

oo  N(ui)  oo 

n=l  n=l  n=N{u)+l 

<     El^n|+      E      ^^'^    (by  (2.2.16)) 

n=l  n=N(w)+\      9n{i^) 


JS(u/)  oo  /  1        ' 

<        El^nl  +  M        X:         5n(|X„|)     (M  =  -^ 

n=l  n=7VM+l  \  5'Uij, 


n=N{w)+l 

<    OO  (by  (2.2.14)) 


and  so 


M 


y^  X„  converges  a.s. 
t»=i 

Therefore  {Tn,n  >  1}  is  a  well-defined  sequence  of  random  variables. 
Next,  let 

c„  =  E(y„(|X„|)),  n>l 

and  observe  that 

oo 

Cn  >  0,  n  >  1  and  ^  Cn  <  oo  a.s.    (by  (2.2.4)). 

n=l 

Since  An  =  Yl'^n  ^i  ^0'  "  ^  !>  Lemma  2  ensures  that  for  each  function  V'(^)  €  ^? 
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For  each  function  ^(a;)  €  ^,  since 

then  setting 

K  =  g-'{AnHA;:')),  n>l, 

(2.2.8)  and  (2.2.9)  follows  directly  from  (2.2.5)  and  (2.2.17),  respectively.  Thus  the 
theorem  follows  from  Lemma  4  since  5f„(6„)  =  Anip{A~^)  =  0(1)  (see  Remark  (ii) 
after  the  statement  of  Theorem  1).  □ 

We  obtain  the  following  two  truncated  versions  of  Theorem  1  as  corollaries. 

Corollary  1.  Let  {Xn^  n  >  1}  6e  random  variables  and  let  {5'n(a;),  n  >  1}  he 
strictly  increasing  functions  defined  on  [0,  oo)  satisfying  (2.2.1),  (2.2.2)  and  (2.2.3). 
// 

5;:P{|^n|>Cn}<00  (2.2.18) 


n=l 

and 


Y,  e(5„(|X„  I[|x„|<c„]|))  <  ^  (2.2.19) 

n=l 

are  satisfied  for  some  sequence  of  positive  constants  {C„,  n  >  1],  then  setting 

^n  =  EE(yi(|X,ta<c,j|)),  n>l 

j=n 

and  assuming  that  for  some  function  ^'(a;)  €  ^ 

P  {l^n  kxn\<Cn]\  <  9n'  (A  H^n^))  eventually  }  =  1,  (2.2.20) 

the  tail  series  SLLN 

T 

0  a.s.  (2.2.21) 


9n'{Ar.HA-')) 
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obtains. 

Remarks,  (i)  A  sufficient  condition  for  (2.2.20)  to  hold  is 

E  P  {l^n  I[|;.„|<C„]|  >  g:'  (a  ha-'))  }  <  OO, 
n=l 

by  the  Borel-Cantelli  lemma. 

(ii)  Since  (2.2.18)  asserts  that  {X„,  n  >  1}  and  |X„  I[|x„|<c„],  «  >  l}  are  equiv- 
alent in  the  sense  of  Khintchine,  (2.2.21)  is  equivalent  to 

.-    "    ~ — r-  -^  0  a.s.  (2.2.22) 

9n'{AnHA;:'))  ^  ^ 

where  j;  =  ET=n ^j  kx,\<c,],  n  >  I.  Note  that  g-' [A,.  HAn'))  l  By  the  ar- 
gument in  the  remark  after  the  statement  of  Lemma  4,  mutatis  mutandis,  (2.2.22) 
ensures  the  condition  (2.2.20).  Thus  the  condition  (2.2.20)  is  necessary  for  (2.2.21) 
to  hold. 

(iii)  The  condition  (2.2.18)  ensures  that  (2.2.20)  is  equivalent  to  the  apparently 
stronger  but  structurally  simpler  condition 

P  {l^nl  <  g-'  {An  i^{A-'))  eventually  }  =  1. 
Proof  of  Corollary  1.  Set 

Zn  =  Xnl[\Xn\<Cn],    n  >  1. 

Then,  by  applying  Theorem  1  to  the  random  variables  {Zn,  n  >  1},  (2.2.19)  ensures 
that  the  tail  series  T*  =  YlJL^  Zj  is  well  defined  and  then  (2.2.22)  obtains  for  each 
function  ip{x)  €  *.  Since  {A'„,  n  >  1}  and  {Xn  I[|x„|<c„],  n  >  1}  are  equivalent  in 


2a 

the  sense  of  Khintchine,  {r„,n  >  1}  is  also  well  defined  and  the  corollary  follows. 

a 

Corollary  2.  Let  {Xn,  n  >  1}  6e  random  variables  and  let  {gnix),  n  >  1}  6e 
strictly  increasing  functions  defined  on  [0,  oo)  satisfying  (2.2.1),  (2.2.2)  and  (2.2.3). 
7/(2.2.18)  and 

f;  E{g4\Xr,  l[\x„\<c„]  -  E(X„  I[|x„|<c„])|))  <  oo  (2.2.23) 

n=l 

are  satisfied  for  some  sequence  of  positive  constants  {C„,  n  >  1},  then  setting 

oo 

A  =  E  E(5i(l^i  kxA<cA  -  E(^i  kx,\<c,])\)),  n  >  1 

j=n 

and 

Tn  =  E  {Xj  -  E{Xj  l[ix,\<c,])},  n  >  1,  (2.2.24) 

j=n 

and  assuming  for  some  function  ip{x)  G  ^  that 

P  {|^n  kx„\<c„]  -  e(x„  I[|x„|<c„])  I  <  g-'  {An  0(i;'))  eventually  }  =  1,  (2.2.25) 
the  tail  series  SLLN 


T, 


n 


obtains. 


(2.2.26) 


Remarks.  By  the  argument  in  Remarks  (i),  (ii),  and  (iii)  after  the  statement  of 
Corollary  1,  mutatis  mutandis,  we  observe,  respectively,  that 
(i)  A  sufficient  condition  for  (2.2.25)  is 

£  P  {|^n  I[|X„|<C„1  -  E(X„  It|X„|<C„])  I  >  g:'  {An  i^iAZ'))  }  <  OO. 
n=l 
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(ii)  The  condition  (2.2.25)  is  necessary  for  (2.2.26)  to  hold. 

(iii)  The  condition  (2.2.18)  ensures  that  (2.2.25)  is  equivalent  to  the  condition 

P  {|X„  -  E(X„  I[|;t„|<c„])  I  <  g-'  (a  i>{A-'))  eventually  }  =  1.      - 
Proof  of  Corollary  2.  Set 

Zn  =  Xn  I[|X„|<C„]  -  E(X„  I[|A-„|<C„])  ,    «  >  L 

Then  the  result  follows  from  (2.2.18)  and  (2.2.23)  by  employing  the  argument  in 
Corollary  1,  mutatis  mutandis.  D 

2.3     Tail  Series  SLLNs  for  Independent  Random  Variables 

For  independent  random  variables  {Xn,  n  >  1}  we  obtain  the  following  tail 
series  SLLNs,  In  part  (i)  of  the  ensuing  theorem,  the  condition  (2.2.5)  of  Theorem 

1  is  dispensed  with  at  the  expense  of  assuming  that  {X„,  n  >  1}  are  independent. 
The  main  result  of  this  section,  Theorem  2,  may  now  be  stated.  As  in  Theorem 
1,  it  will  be  shown  in  the  proof  of  Theorem  2  that  the  hypotheses  ensure  that 
{Tn,n  >  1}  is  a  well-defined  sequence  of  random  variables.  The  proof  of  Theorem 

2  will  be  deferred  until  after  the  proof  of  the  ensuing  Lemma  6. 

Theorem  2.  Let  {Xn,  n  >  1}  6e  independent  random  variables  and  let  {gnix),  n  > 
1}  be  strictly  increasing  functions  defined  on  [0,  oo)  such  that 

gJO)  =  0  and  lim  gJx)  =  oo,  n  >  1  (2.3.1) 

and  assume  that 

gnix)  is  nondecreasing  in  n  for  each  fixed  x  >  0.  (2.3.2) 
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Suppose  that  one  of  the  following  two  conditions  prevails 

X 

{i)  — j-r  is  nondecreasing  as  0  <  x  1  for  each  n  >  1. 
9n{x) 

0  ( X]  X 

(ii)  is  nondecreasing  as  0  <  x  '\,  — — — ■  is  nondecreasing  as  0  <  x  T, 

^  9n{x) 

and  E{Xn)  =  0,  for  each  n  >  1. 
//  the  series 

00 

J2^{g4\Xr.\))  <  oo,  (2.3.3) 

then  setting 

An  =  f:E(gj{\Xj\)),  n>l, 

j-n 

the  tail  series  SLLN 


T 

U  a.s. 


obtains  for  each  function  xp{x)  €  ^,  where  g~^  denotes  the  inverse  function  of  gn  for 
each  n  >  1. 

Remark.  Note  that  for  each  n  >  1,  the  hypotheses  to  (t  )  or  {ii  ),  together 
with  the  fact  that  each  gn{x)  is  a  nondecreasing  function,  imply  that  each  gn[x)  is 
necessarily  a  continuous  function.  Under  the  hypotheses  to  (t  )  the  continuity  of 
each  gn{x)  follows  directly  from  Remark  (iii)  after  the  statement  of  Theorem  1.  So 
it  is  enough  to  show  that  each  gn{x)  is  a  continuous  function  under  the  hypotheses 
to  [ii ).  To  this  end,  we  will  prove  that 

gn{xQ)  =  gn{xo)  for  arbitrary  xq  G  (0,  oo)  and  for  each  n  >  1.  (2.3.4) 

Let  0  <  5  <  xo  <  ^.  Then  (it)  of  the  theorem  ensures  that 


fifn(s)  gn{Xo)  gn{ty 
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Take  s  ^  xq  and  t  [  xq.  Then 


=  lim  — TT  ■<  lim — T-T-  =  — t^lt,  n  >  1. 


9n{xo)      sUo  gn{s)      U^o  5f„(<)      gnixo) 
Therefore  for  each  n  >  1, 

9nixo)  >  gni^o)  for  arbitrary  Xq  €  (0,  oo)  and  for  each  n  >  1. 

Hence,  via  the  monotonicity  of  each  gn,  (2.3.4)  follows.  □ 

Theorem  2  reduces  to  Proposition  4  by  setting  gn  =  g,  n  >  1.  And  also  Theorem 
2,  under  the  hypotheses  to  (i),  follows  directly  from  Theorem  1  by  assuming  the 
condition  (2.2.5)  which  is  a  necessary  condition  for  the  result  to  hold.  Moreover,  as 
will  become  apparent,  Theorem  2,  under  the  hypotheses  to  (tt),  owes  much  to  the 
work  of  Klesov  [30]. 

The  proof  of  Theorem  2  utilizes  the  following  two  lemmas. 

Lemma  5  (Petrov  [38]).  Let  {Xn,  n  >  1}  be  independent  random  variables  and 
let  {gn{x),  n  >  1}  6e  nondecreasing  functions  defined  on  [0,  co)  satisfying  (2.3.1). 
Assume  that  condition  (i)  or  {ii)  of  Theorem  2  holds.  Further,  let  {6„,  n  >  1}  be 
a  sequence  of  positive  constants.  If  the  series 

f  E(gn(|X„|)) 


then  the  series 


oo     Y 

y^  -r-"  converges  a.s.  (2.3.6) 

n=l    "n 


Lemma  5,  under  the  condition  (u)  of  Theorem  2,  was  proved  for  the  case  ^„  = 
g,n>l,hy  Chung  [17,  p.  124]. 
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Using  Lemmas  1  and  5,  we  obtain  the  following  lemma. 

Lemma  6.  Let  {X„,  n  >  1}  be  independent  random  variables  and  let  {gni^),  n  > 
1}  be  nondecreasing  functions  defined  on  [0, oo)  satisfying  (2.3.1).  Assume  that 
condition  (i)  or  (ii)  of  Theorem  2  holds.  Let  {6„,  n  >  1}  be  a  sequence  of  positive 
constants  with  fe„  |  0.  If  gn{bn)  =  0(1)  and  (2.3.5)  holds,  then  the  tail  series  SLLN 

T 

7 >  0  a.s. 

On 

obtains. 

Proof.  Note  that  (2.3.5)  and  5f„(6„)  =  0(1)  ensure  (2.3.3)  which,  as  will  be 
demonstrated  in  the  proof  oi  Theorem  2,  ensures  that  {r„,n  >  1}  is  well  defined. 
Employing  Lemma  5  yields  (2.3.6).  Since  6„  |  0,  the  lemma  follows  from  Lemma  1. 

a 

Not  only  does  Lemma  6  reduce  to  Proposition  3  by  taking  gn  =  g,  n  >  1,  but 
it  also  is  a  tail  series  analogue  of  Petrov  [40,  Section  9.  3,  Theorem  11].  Moreover, 
if  (2.2.8)  holds,  then  under  the  hypotheses  to  (i)  of  Theorem  2,  Lemmas  5  and  6 
follow  directly  from  Lemmeis  3  and  4,  respectively. 

The  proof  of  Theorem  2  may  now  be  given. 

Proof  of  Theorem  2.  Note  at  the  outset  that  in  the  proof  of  Theorem  1  the 
condition  (2.2.5)  was  not  employed  to  establish  that  the  tail  series  {r„,n  >  1}  is 
well  defined.  Consequently,  under  the  hypotheses  to  (i),  {r„,  n  >  1}  is  a  well-defined 
sequence  of  random  variables. 

Next,  it  will  be  verified  by  employing  the  Kolmogorov  three-series  criterion  that 
under  the  hypotheses  to  (u),  X)^i  Xn  converges  a.s.  and  hence  {T„,n  >  1}  is  well 
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defined.  For  each  n  >  1 

P{|X„|>1}    =    PK(|X„|)>5„(1)} 


E(«7n(|X„|)) 

<     7-T — ^  (by  the  Markov  inequality) 

<  ME(,„(IXI))    {m  =  ^) 


and  so 


J2  P  {l^nl  >  1}  <  M  $:  E(«7n(|J^n|))  <  OO    (by  (2.3.3)). 
n=l  n=l 

Now  for  each  n  >  1 


H^n  I[|x„|<ii)  I    =    |E(^n  I[|x„|>i])  I  (since  E(X„)  =  0) 

<     E(|X„|I(,;,„,>i]) 

E(5r„(|X„|)If|;,„|>lj)     (    ,  X  1  \ 

</n(l)  V  5'n(a:)       ^„(1)  J 

^      E(ffn(|X„|)) 
5n(l) 


Thus, 


<    A/E(j„(|X„|))  (m  =  ^) 


oo  oo 

E  E|^n  I[|x„|<i]|  <  M  5:  e(5„(|X„|))  <  oo   (by  (2.3.3)) 


n=l  n=l 

implying  that 


n=l 

Again,  for  each  n  >  1 


oo 

X1e(A'„I[|a'„|<i])  converges. 


Var(x„I[,x„|<i])     <    E(x„^It,x„|<i]) 


^     E(jrn(|X„|)I[|x„|<i])  /.  a:^     ^      1 

-    TTn ^'^'^^  ~~rT  -  ~~nT'  ^  -  ^ 


< 
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E(5r„(|X„|)) 


^n(l) 
<    ME(,„(|X„1))    [m  =  ^) 

implying 

oo  oo 

Y:  Var(X„  It|x„|<i])  <MY:  E(^„(|X„|))  <  cx)    (by  (2.3.3)). 


n=l  n=l 


■.:-i 


> 


>""?? 


Hence  the  conditions  of  the  the  Kolmogorov  three-series  criterion  are  satisfied 
thereby  ensuring  that  \, 

y^  Xn  converges  a.s. 

n=l 

Therefore,  in  both  cases,  {T„,  n>  1}  is  a  well-defined  sequence  of  random  variables. 
Next,  let 

Cn  =  E[g4\Xn\)),  n>l 

and  observe  that 

oo 

Cn  >  0,  n  >  1,  and  J^Cn<oo  {hy  (2.3.3)). 

n=l 

Since  An  =  Yl'jLn  <^i  >■  0,  ti>1,  Lemma  2  ensures  that  for  each  function  '>p{x)  G  ^, 

^         E(g„(|X„|))         _  ^  E(g„(|X„|))  r    'W 

n=l^n(^„-^(X^(>4-l)))  n^l    AV'(>ln')     ^  "^^  '         "     -V 

Now  for  each  function  tl^{x)  E  ^,  since  V 

o<5r;HAV'(^;^))io,  .        .    ;  X| 

■  i 

setting 

i 

K=9:'{Anrl>{^:')),  n>l. 
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the  condition  (2.3.5)  holds.  The  theorem  then  follows  directly  from  Lemma  6  since 
94K)  =  Ar.^kiA-')  =  0{l).  D 

We  obtain  the  following  two  truncated  versions  of  Theorem  2  as  corollaries  by 
employing  an  argument  similar  to  that  used  to  establish  Corollaries  1  and  2  of 
Section  2.1. 

Corollary  3.  Let  {Xn,  n  >  1}  6e  independent  random  variables  and  let  {gn{x),  n  > 
1}  be  strictly  increasing  functions  defined  on  [0,  oo)  satisfying  (2.3.1)  and  (2.3.2). 
Assume  that  the  condition  (i)  or  (ii)  of  Theorem  2  holds.  If 


n=l 


X;P{lX„|>C„}<oo  (2.3.7) 

and 


J2  ^{gnilXn  I[|;f„|<C„]|))  <  OO  (2.3.8) 

n=l 

are  satisfied  for  some  sequence  of  positive  constants  {C„,  n  >  1},  then  setting 

A»  =  f;E(fifi(|^ita<c,]|)),  n>l, 

j'=n 

the  tail  series  SLLN 

^"  0  a.s.  (2.3.9) 


obtains  for  each  function  il>{x)  €  ^. 

Remark.  A  necessary  condition  for  (2.3.9)  to  hold  is  that  (2.3.7)  obtains  with 

Cn=9;'{AnrP{A-')),  n  >  1.  (2.3.10) 

Proof  of  Remark.  The  triangle  inequality  and  the  fact  that  g~^  (An  ipiA'^))  J. 
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imply 

9-^  (a.  ^{A-^))       9-'  [An  HA-^))      9nU  (A+1  ^{A-U))  '  "  "    ■ 


Thus  (2.3.9)  ensures 


0  a.s. 


9n'{^^{A-')) 

Using  the  Borel-Cantelli  lemma  and  the  independence  of  {X„,  n  >  1},  we  obtain 

oo 
n=l 

Hence  (2.3.7)  holds  with  {C„,  n  >  1}  as  in  (2.3.10).  □ 
Proof  of  Corollary  3.  Set 

Zn  =  XnI[|A-„|<C„],    n  >  1. 

Then,  by  applying  Theorem  2  to  the  random  variables  {Z„,  n  >  1},  (2.3.8)  implies 
that  the  tail  series  T*  =  Yl%n  ^i  is  well  defined  and  the  tail  series  SLLN 

T* 

■  0  a.s. 


5„-^(inV'(i;:^)) 

obtains  for  each  function  V'(a;)€^.  Since  (2.3.7)  implies  that  {X„,  n  >  1}  and 
{Xn  \\Xn\<Cn]i  >*  ^  1}  are  equivalent  in  the  sense  of  Khintchine,  {r„,n  >  1}  is  also 
well  defined  and  Corollary  3  follows.  □ 

Corollary  4.  Let  {X„,  n  >  1}  6e  independent  random  variables  and  let  {5'„(x),  n  > 
1}  he  strictly  increasing  functions  defined  on  [0,  c»)  satisfying  (2.3.1)  and  (2.3.2). 
Assume  that  condition  (i)  or  (ii)  of  Theorem  2  holds.  If  (2.3.7)  and 

oo 

Y:  E(y„(|X„  I[|x„|<c„]  -  E(X„  I[|x„|<a„])|))  <  oo  (2.3.11) 

n=l 
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are  satisfied  for  some  sequence  of  positive  constants  {C„,  n>  I},  then  setting 

oo 

A  =  E  E(^i(|^,  kx,\<c,]  -  E(X,-  I[,x,|<a,])|)),  n  >  1 

i=n 

oo 

^n  =  E{^i-E(^iI[|;c,|<c,])},n>l, 

j=n 

the  tail  series  SLLN 

^-  n 

0  a.s. 


obtains  for  each  function  'ip{x)  €  ^. 
Proof.  Set 

Z„  =  Xn  \\Xn\<c„]  -  E(X„  I[|a^„|<c„])  ,  n  >  1. 

Then  the  corollary  follows  from  (2.3.7)  and  (2.3.11)  by  employing  the  argument  in 
Corollary  3,  mutatis  mutandis.  □ 

2.4     Examples 

Three  examples  are  provided  to  illustrate  some  of  the  current  results  as  well  as 
to  compare  them  with  related  results  in  the  literature. 

Example  1.  Let  {Xn,  n  >  1}  be  random  variables  (not  necessarily  independent) 
such  that 

Pf^n  =  ^1  =  1  -  ^  and  P{X„  =  e"}  =  ^,  n  >  1. 

Then  for  any  p  €  (0, 1], 


EW)  =  ;^(.-;^)  +  5,n>l 
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and  so 

f;E(|X„n  =  ooforallpe(0,l]. 

n=l 

Therefore  the  hypotheses  of  Proposition  2  are  not  met. 
Let  I  <  q;  <  1  and  let 

gn{x)  =  (logi  x)°,  n  >  1.  (2.4.1) 

Then,  recalling  the  definition  of  log^  x,  the  conditions  (2.2.1),  (2.2.2),  and  (2.2.3) 
are  satisfied.  For  each  n  >  1 

e(,„(|x„|))  =  E((iog,  |x„ir)  =  l-L  (i  -  Jj)  +  ^ 

and  so 

OO  OO         y'         1  X 

EE(5n(|Xn|))<E{i  +  ""-^}<«). 
n=l  n=l   ""^  '' 

Hence  (2.2.4)  holds. 
Now  for  n  >  1, 

OO 

An      =      EE((logJX,|)") 

~    Ml  n^-^"  +  Ma  n""^   (m^  =  —  —^  and  Mj  =  -^)  .  (2.4.2) 

V  e«  2a  -  1  1  -aj     ^         ' 

Suppose  that  |  <  a  <  |.  Then 

If  '^{x)  is  taken  to  be  the  function 

V'(x)  =  (logi  x)^+'  where  e  >  0,  (2.4.3) 


'4 
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then  for  all  large  n 

=    o(l). 
Therefore,  for  all  large  n 

implying  .  ,  :' 

^       9;'{A.HA-'))  =  e{Ar.i;{A-'))^  ^  M,ni-'  (log.n)'^   {M.^eM,^). 

Thus, 

P{|X„|  >  g-"^  (a  ha:')) }  =  ^  for  all  large  n  (2.4.4) 

and  so,  via  Remark  (i)  after  the  statement  of  Theorem  1,  the  condition  (2.2.5)  also 
holds.  Hence  for  each  «  €  (|,  |  ,  the  tail  series  SLLN 

—^  0  a.s. 


na   ^(login) 
obtains  by  Theorem  1,  i.e., 


2-i 


,Iir^n-^Oa.s.  (2.4.5) 

(logi  n)  a 

On  the  other  hand,  suppose  that  |  <  a  <  1.  Then  recalling  (2.4.2),  ;...' 

An^M2n"-\ 

If  rl){x)  be  taken  to  be  the  function  as  in  (2.4.3),  then  for  all  large  n  .        ^i^ili 

An^A:')    ~    Msn°'-'{\og,ny+'  {Ms  =  {l-ay)  ': 

=    o(l) 
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implying 

for  all  large  n  and  so 

Thus,  (2.4.4)  holds  and  so,  via  Remark  (i)  after  the  statement  of  Theorem  1,  the 

condition  (2.2.5)  also  holds.  Hence  for  each  a  G  (|,  Ij,  the  tail  series  SLLN 

T 

— »  0  a.s. 


n^   "  (logi  n) 
obtains  by  Theorem  1,  i.e.. 


nt-i 


,Iir^n^Oa.s.  (2.4.6) 

(logi  n)  " 

Next,  it  will  now  be  demonstrated  that  Corollary  1  can  be  also  applied.    Let 
I  <  p  <  1  and  let 

<7„(x)  =  |x|P,  n  >  1.  (2.4.7) 

Then  the  conditions  (2.2.1),  (2.2.2),  and  (2.2.3)  are  satisfied.  Set 

C„  =  2,  n  >  1.  (2.4.8) 

Then 

P{|^n|  >  Cn}  =  ^,    n  >  1 

implying  (2.2.18).  Also 

E(^n(|X„I[|x„|<a„]|))    =    ^{\Xnkx„\<c4) 

„2p  \^       „2  y 
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and  so 


oo 

<  oo. 


oo  oo       1 

EEM|X„I[,;.„,<c„il))<E-i? 

n=l  n=l  " 

Thus  the  condition  (2.2.19)  holds.  Now  for  n  >  1, 

oo 


~    Mjn^-^P   \M7=       ^ 


2p-lJ 
If  'ip{x)  be  taken  to  be  the  function  as  in  (2.4.3),  then  for  all  large  n, 

i„V(^;^)    ~    M8n^-2p(log,„)i+=  (M8  =  (2;,-l)=) 
=    o(l). 

Hence  for  all  large  n, 

implying 

g:' (i„ i^{A:'))  =  (i„  rk{A-'))  '  ~  Mg  UP-'  (log,  n)"-^   [m^  =  M^\)  . 

Thus,  (2.4.4)  holds  and  so,  via  Remark  (i)  after  the  statement  of  Corollary  1,  the 
condition  (2.2.20)  also  holds.  Therefore,  by  Corollary  1  the  tail  series  SLLN 

T 

0  a.s. 


np      (log,  n)  p 
obtains,  i.e.. 


2-1 

n     p 

1+7  Jn  -»  0  a.: 


(logi  n) 
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Not  only  is  this  result  sharper  than  (2.4.5)  for  p  >  a,  a€  (|)|])  but,  also, 
this  result  is  sharper  than  (2.4.6)  for  p  >  5^,  a€  (f,!)-  Hence,  for  p6  f|,l  , 
Corollary  1  gives  us  a  better  result  than  that  which  can  be  obtained  by  Theorem  1 . 

In  conclusion,  it  may  be  noted  that  Theorem  2  and  Corollary  3  can  also  be 
appHed  to  this  example  by  setting  {^^n,  n  >  1}  as  in  (2.4.1)  or  as  in  (2.4.7),  respec- 
tively, if  {Xn,  n>  1}  are  assumed  to  be  independent. 

Example  2.  Let  {Xn,  n  >  1}  be  random  variables  (not  necessarily  independent) 
such  that 

P{X„  =  1}  =  1  -  i-  and  P{X„  =  e"}  =  i-,  n  >  1. 

Then  for  any  p  €  (0, 1], 

E(W)=(l-l)  +  5,n>l 

and  so 

00 

X^E(|X„r)  =  oo,  for  all  pe  (0,1]. 

n=l 

Therefore  the  hypotheses  of  Proposition  2  are  not  met. 

It  will  now  be  demonstrated  that  Corollary  2  can  be  applied.  Let  |  <  p  <  1. 
Then  by  the  argument'va.  Example  1,  setting  {gn^  n  >  1}  as  in  (2.4.7)  and  {C„,  n  > 
1}  as  in  (2.4.8),  the  conditions  (2.2.1),  (2.2.2),  (2.2.3),  and  (2.2.18)  are  satisfied. 
Moreover,  for  each  n  >  1 

E((7n(|Xn  V„|<c„]  -  E(X„  V„|<c„])|))    =    e(|x„  Ii|x„|<c„]  "  E(X„  I[|x„|<c„])r) 

=    E(Kl,x„„c„)-(l-^)f) 
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implying 


oo  °°       f      1  1      ^ 

EE(^n(|X„I[|;,„|<C„]-E(X„V„|<C„])|))   <   ^      —  +  -}  < 
n=l  n=l   *•"  "    "' 


CX>. 


Hence  (2.2.23)  holds. 
Next  for  n  >  1, 


X    =    f:K\^A\xA<cA-'^{^A\x,\<c,])\'') 
~    Ml v}-^"    [Ml  =  r-^]  . 


If  xj^{x)  be  taken  to  be  the  function  as  in  (2.4.3),  then  for  all  large  n, 

A  H^-')    ~    M2  n'-^"  (logi  n)^+^  (M2  =  (2p  -  1)=) 
=    o(l). 

Hence,  for  all  large  n 


Ani^{A-')<l 


and  so 


^„-^(^„V(^;^))  =  (A0(^;^))^  -  Ma  up-^  (log,  n)"^   (M3  =  M^")  . 
Thus,  for  all  large  n 

P{|^„I[|;c„|<c„]  -  E(x„Inx„|<a„])|  >  9:'{A.HAZ'))} 
=    P{\kx„\<2]-n\Xn\  <  2}|  >  9;'{A^rP{A:'))} 

<      P  {[|X„|  <  2]  n  [|  V„|<21  -  P{|^n|  <  2}|  >  g-'  {An  ha:'))]  }  +  n\Xn\  >  2} 


•\'-^' 


'-i7-*?; 
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=  p|[|X„|<2]n[i-i  +  l>5r„-^(^„VM;^))]}  +  P{|x„|>2} 

=      P{l^n|>2} 

1 

and  so  by  Remark  (i)  after  the  statement  of  Corollary  2  the  condition  (2.2.25)  also 
holds.  Therefore,  by  Corollary  2,  the  tail  series  SLLN 

f 


n'      (logi  n)  p 


0  a.s. 


obtains  for  the  tail  series  {T„,  n  >  1}  defined  a^  in  (2.2.24),  i.e., 

2-i 

TjrTn^Oa.s. 

(logjn)  p 

In  conclusion,  it  may  be  noted  that  Corollary  4  can  also  be  applied  to  this 
example  by  setting  {gm  n  >  1}  as  in  (2.4.7)  in  the  case  when  {Xn,  n  >  1]  are 
assumed  to  be  independent. 

In  the  following  example,  we  will  consider  the  rate  of  almost  sure  convergence 
of  the  harmonic  series  with  a  random  choice  of  signs. 

Example  3.  Let  {X„,  n  >  1}  be  independent  random  variables  such  that 


P(X„  =  1}  =  P(X„  =  -i}  =  i,  n  >  1. 


The  series  of  partial  sums  ^n  =  I3j=i  Xj,  n  >  1,  can  be  interpreted  as  the  harmonic 
series  with  a  random  choice  of  signs.  We  will  employ  Theorem  2  to  determine  its 
rate  of  convergence  to  a  random  variable. 


i» , 


Let  0  <  a  <  1  and  let  ,; -*^ 


9n{x)  =  n    °x  ,  n  >  I,  and  g{x)  =  gi{x)  =  x  ,  x  >  0. 
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Then  the  conditions  (2.3.1),  (2.3.2),  and  {ii  )  of  Theorem  2  are  satisfied.  For  each 
n>  1, 

E(^„(|X„|))  =  n-(^+")  and  E{gi\Xr.\))  =  n'^ 

implying  (2.3.3)  and  (2.1.1),  respectively.  Therefore,  all  the  hypotheses  of  Theorem 
2  as  well  as  all  the  hypotheses  of  Proposition  4  (with  g{x)  =  gi{x)  =  x'^)  are 
satisfied. 

Now  for  n  >  1, 

oo  oo 

A.  =  E^ajilXjl))  =  Ei"^'"""^  ~  ^1"""  K  =  «~0  (2-4.9) 

and 

oo  oo 

An  =  Ee(p(|^,|))  =  Er'-n-'  (2.4.10) 

j=n  j=n 

If  V'(3;)  be  taken  to  be  the  function 

1p{x)  =  y/x, 

then 

and 

implying,  respectively, 

and 

fif-^(A„t/'(A-i))~n-f. 
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Thus,  by  applying  Theorem  2  and  Proposition  4,  the  tail  series  SLLNs 

n2-^7;->0a.s.  (2.4.11) 

and 

n*  r„  -*  0  a.s.  (2.4.12) 

obtain,  respectively.  Hence,  recalling  a  <  1,  (2.4.11)  dominates  (2.4.12).  Therefore 
Theorem  2  gives  us  a  sharper  result  than  that  which  can  be  obtained  by  Proposition 
4. 

Next,  by  taking  '(/^{x)  to  be  the  function  as  in  (2.4.3)  of  Example  1,  two  relations 
(2.4.9)  and  (2.4.10)  yield  the  asymptotic  relations 

An  H-^Z')  ~  ^4  n-"  (logi  n)^+'  (M4  =  a') 

and 

Ar,rl>{A-')^n-\\og,ny+% 

respectively.  Thus, 

g-^(^Ani^{A~^))  ~  Mgn-^  (log^n)^   (Ms  =  at) 

and 

g-^  (A„  ^(A-^))  ~  n-2  (logi  n)^. 

Hence,  by  either  Theorem  2  or  Proposition  4,  the  tail  series  SLLN 

"'  TirTn-*Oa.s.  (2.4.13) 


(logi  n) 

obtains  for  arbitrary  £  >  0.    Therefore,  there  is  no  advantage  of  Theorem  2  over 
Proposition  4  in  this  case. 
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Furthermore,  let  {¥„,  n  >  1}  be  a  sequence  of  i.i.d.  random  variables  such  that 

p{r„  =  i}  =  p{r„  =  -i}  =  i,  n>i. 

Consider  the  weighted  i.i.d.  random  variables 

^n  =  On  Yn,  where  a„  =  n~^,  n  >  1. 


Then 


oo  oo      1 

j=n  j=:n  J 


and  so 


nal 


K  =  0(CJ  and  — i  =  0(1). 

Therefore,  by  a  tail  series  LIL  of  Rosalsky  [41,  Theorem  2]  where  ^  therein  is  chosen 
to  be  0,  the  tail  series  LIL 

,.                T,f=n  Qj  Yj  1 

limsup r  =  1  a-s. 


obtains,  i.e.. 


1 


lim  sup r  ^n  =  \/2  a.s.  (2.4.14) 

n-oo     (logjn)^ 


Hence,  for  arbitrary  e  >  0,  the  tail  series  SLLN 


1 

r„  -»  0  a.i 


if+« 


(logjn)' 
obtains.  Thus  this  result  of  the  tail  series  LIL  of  Rosalsky  [41,  Theorem  2]  is  sharper 

than  (2.4.13)  as  well  as  (2.4.11)  and  (2.4.12). 

This  example  illustrates  the  gap  between  the  conclusion  of  the  tail  series  SLLN 

(Theorem  2)  and  that  of  the  tail  series  LIL  of  Rosalsky  [41,  Theorem  2].  Further 

discussion  about  this  will  be  given  in  Chapter  4. 
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CHAPTER  3 
TAIL  SERIES  WEAK  LAWS  OF  LARGE  NUMBERS 


3.1      Introductory  Comments,  Tail  Series  Inequality, 
and  a  New  Proof  of  Klesov's  Tail  Series  SLLN 

As  was  mentioned  at  the  beginning  of  Chapter  2,  in  Klesov's  [29,  Lemma  1] 
proof  of  a  tail  series  version  of  Kolmogorov's  inequality  for  independent  random 
variables,  not  only  was  his  argument  obscure,  but,  also,  he  employed  a  tail  series  in- 
equality without  proving  it.  After  formulating  and  proving  this  tail  series  inequality 
(Proposition  5  below),  we  will  provide  an  alternative  proof  of  the  tail  series  SLLN 
of  Klesov  [29,  Proposition  1]  (which  is  not  based  on  the  tail  series  version  of  the 
Kolmogorov's  inequality  as  was  used  by  Klesov  to  prove  his  tail  series  SLLN).  As  a 
direct  application  of  this  tail  series  inequality,  we  will  establish  tail  series  WLLNs 
for  the  case  of  independent  summands.  Furthermore,  as  special  cases  of  these  tail 
series  WLLNs,  we  will  also  obtain  tail  series  WLLNs  for  weighted  sums  of  i.i.d. 
random  variables.  As  in  Chapters  1  and  2,  {r„,  n  >  1}  denotes  throughout  the  tail 
series  r„  =  J^^^Xj,  n  >  1,  corresponding  to  random  variables  {Xn,  n>\}.  As 
will  be  seen,  the  hypotheses  to  each  of  the  tail  series  results  presented  below  ensure 
that  {Tn,n  >  1}  is  a  well-defined  sequence  of  random  variables.  Hence  T„  — >  0  a.s. 
or,  equivalently, 

sup|r,|^o. 
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As  was  mentioned  in  Chapter  1 ,  these  tail  series  WLLNs  are  of  the  form 

sup|3"j|    p 

^^ ^  0  (3.1.1) 

o„ 

where  {6„,  n  >  1}  is  a  suitable  sequence  of  norming  constants  with  0  <  6„  J.  0. 

Of  course,  if  the  tail  series  SLLN 

T 

7 >  0  a.s. 

On 


holds,  then 


supM_P,„ 

j>n     Oj 


whence  via  0  <  6„  J,  0  the  tail  series  WLLN  (3.1.1)  also  obtains  and  it  involves  the 
same  sequence  of  norming  constants. 

This  tail  series  inequality  under  discussion  may  now  be  formulated. 

Proposition  5  (Klesov  [29]).  Let  {X„,  n  >  1}  he  independent  random  variables 
with  E(\Xn\'')  <  oo,  n  >  1,  for  some  p  >  0.  Assume  that  one  of  the  following  two 
conditions  holds 

{i)0<p<l. 

(u)  l<p<2  and  E(Xn)  =  0. 

oo 

x:E(ix„n<(x>,  (3.1.2) 

n=l 


then  for  every  e  >  0,  the  inequalities 


•|sup|T,|>£| 


<^tn\xjnn>i 


obtain  where  Cn  (p)  G  (0, 2]  is  a  sequence  of  constants  depending  only  on  p. 
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The  proof  of  Proposition  5,  which  will  be  given  below,  utilizes  the  following 
Lemmas  7  and  8  and  the  proposition,  under  the  assumption  {it  ),  is  indeed  a  tail 
series  analogue  of  Lemma  7  which  concerns  partial  sums  of  independent  random 
variables. 

Lemma  7.  Let  S„  =  Yl]=i  Xj,  n>  1  where  {Xn,  n  >  1}  are  independent  random 
variables  satisfying  for  some  p  6  (1, 2] 

E(|X„n  <  oo  and  E(X„)  =  0,  n  >  1. 

Then  for  all  e  >  0,  the  inequalities 

P{max  |5,|  >e\<  ^EE(|X,n,  n  >  1 


obtain. 

Proof.  Note  at  the  outset  that  the  hypotheses  ensure  that  {Sn,  ^n,  n  >  1}  is 
a  martingale  where  ^n  =  cr{Xi,  X2,  ...,  Xn) ,  n  >  \,  and  so  {|5'„|'',  J^m  n>\] 
is  a  submartingale  (see,  e.g..  Chow  and  Teicher  [14],  p.  232)  since  the  function 
(p{t)  =  \t\^  is  convex.  Then 


P{m^j5,|>e}    =    P{m^j^,f  >e^} 


<  E(|5nn 

e" 

(by  Doob's  submartingale  maximal  inequality  [18,  p.  314]) 

<  ^EEd^il") 

by  employing  the  von  Bahr-Esseen  [8]  inequality.  Thus  the  lemma  follows.  □ 

Lemma  8.  Let  {Xn,  n  >  1}  be  independent  random  variables  satisfying  for  some 
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P€(l,2]  /    ^  '       i  / 

Ed^nl")  <  c»  and  E(X„)  =  0,  n  >  1. 

For  each  n  >  1  and  I  <  k  <  n,  let 

n 

TAen  /or  a//  choices  of  n  and  k  with  I  <  k  <  n  and  for  all  e  >  0,  the  inequality 

p{max|5„,|>s}<^|:E(|X,n 

J— #C 

obtains. 

Proof.  Fix  n  >  1  and  1  <  fc  <  n.  Set 

s;  =  J2^n+i-i,  i<j<n  +  i-k 

and  note  that 

{Snj:j  =  k,  ...,  n}  =  {s;:j  =  n  +  l-k,  ...,  l}. 

Then,  applying  Lemma  7  to  the  random  variables  {Xn,  X„_i,  ...,  Xk}  ,  it  follows 
that  for  £  >  0, 

thereby  proving  the  lemma.  □ 

Proof  of  Proposition  5.  Let  gn{x)  =  Ixj",  0  <  p  <  2,  n  >  1.  Then,  by  the 
argument  in  the  proof  of  Theorem  2  of  Chapter  2,  (3.1.2)  ensures  that  {Tn,  n>l} 
is  a  well-defined  sequence  of  random  variables. 


..       5  ■ 
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Firstly,  suppose  that  the  assumption  (i)  holds.  Then 


p|sup|7;|>£|  <  p|f;|x,|>£| 


=  p  (Ei^.ir>^'' 


]=n 


<  \^iif^\Xj\)A   (by  the  Markov  inequality) 

(by  the  Lebesgue  monotone  convergence  theorem) 

<  i^hm^Ef|;|X,H  (since  |a  +  6|P<|a|'' +16^    0<p<l) 

1    °° 

j=n 

again  by  the  Lebesgue  monotone  convergence  theorem.  Thus,  the  proposition  fol- 
lows under  the  assumption  (i)  with  C„(p)  =  1. 

Next,  Lemma  8  will  be  employed  to  prove  Proposition  5  under  the  assumption 
(«).  Note  that  for  iV  >  n  >  1, 

M 


p(  max  \TA  >  e\    =    pi  max  I  lim  Y XA  > 

lim  E^.l>4 

I— ►oo  r-T  I 

«=j  ) 

f  ^  1 

=    P<   lim    max  |y^X,|>e> 

|Af-oon<j<iV '^        '  J 


=    P<  max    lim 

n<j<N  M- 


=    EI 


lim    max  ly^**  A-i|>e 


<    Elliminfl 

Af-*oo 


max  1^^  .yj>e 
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<    liminfE 

M-+00 


Ir  -i  I  (by  Fatou's  lemma) 


M 

=    liminfP<   max  iy^X,|>£ 

A/-+00         I  n<j<N  '^.         ' 


f  "^  1 

iminfP<   max  |y^X|>e> 

M-»oo         I  n<j<M    fr'-  J 


<    lim 


2    ^ 

<    lim  inf  —  V  E(  \Xj  I")  (by  Lemma  8) 

n      oo 


Letting  N  —*  oo  yields 

n      oo 
j=n 

thereby  proving  the  proposition  under  the  assumption  (n')  with  Cn{p)  =  2.  □ 

Now,  using  Proposition  5,  we  will  re-prove  (in  Proposition  6  below)  the  tail  series 
SLLN  of  Klesov  [29,  Proposition  1]  which  we  had  questioned  earlier.  Of  course. 
Proposition  6  is  merely  the  special  case  g{x)  =  \x\'^,  0  <  p  <  2,  of  Proposition  3  of 
Chapter  2  as  well  as  the  special  case  gn{x)  =  Ixl^,  0  <  p  <  2,  n  >  1,  of  Lemma  6 
of  Chapter  2  but  an  alternative  proof  may  be  of  interest. 

Proposition  6  (Klesov  [29]).  Let  {Xn,  n  >  1}  be  independent  random  variables 
with  E(|X„|'')  <  oo,  n  >  1,  for  some  p  >  0.  Assume  that  either  of  the  condition  (i) 
or  (u)  of  Proposition  5  holds.  Let  {i„,  n  >  1}  be  a  sequence  of  positive  constants 
with  bn  I  0.  If  the  series 

f;M<^,  ,,,3, 

n=l  "" 
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then  the  tail  series  SLLN 

b„ 


T 

-; >  0  U.S. 


-'n 


obtains. 

Proof.  By  the  proof  of  Proposition  5  with  Xn  replaced  hy  b~^Xn,  n  >  1, 
|Z)jln  ^7  -^j5  w  >  l|  is  a  well-defined  sequence  of  random  variables.  Since  6„  J.  0, 
the  proposition  follows  from  Lemma  1  of  Chapter  2.  □ 

3.2      Tail  Series  WLLNs 
Using  Proposition  5,  we  will  prove  tail  series  WLLNs  of  the  form 

On 

where  {fe„,  n  >  1}  is  a  sequence  of  norming  constants  with  0  <  6„  J,  0.    This,  of 
course,  ensures  that 

On 

The  following  theorem  is  comparable  with  Proposition  6. 

Theorem  3.  Let  {Xn,  n  >  1}  6e  independent  random  variables  with  E(|X„|p))  < 
OO;  "  ^  1>  for  some  p  >  0.  Assume  that  either  of  the  conditions  (i)  or  (ii)  of 
Proposition  5  holds.  Let  {6„,  n  >  1}  be  a  sequence  of  positive  constants  with  6„  I  0. 

// 

1    °° 
TpEECI^.n-O,  (3.2.1) 


then  the  tail  series  WLLN 


^n,t„ 


supITjI 

^^ ^  0  (3.2.2) 


49 

obtains. 

Remark.  Note  at  the  outset  that  Lemma  1  of  Chapter  2  ensures  that  (3.1.3) 
implies  (3.2.1).  Thus,  while  in  Theorem  3  we  obtain  a  weaker  conclusion  than  that 
of  Proposition  6,  we  use  a  weaker  assumption. 

Proof  of  Theorem  3.  Since  (3.2.1)  implies  (3.1.2),  taking  ^„(a:)  =  {x]'^,  0  <  p  < 
2,  n  >  1,  we  see  that  {r„,  n  >  1}  is  a  well-defined  sequence  of  random  variables 
by  the  argument  in  the  proof  of  Theorem  2  of  Chapter  2.  Alternatively,  it  may  be 
noted  that  (3.2.1)  implies  (3.1.2)  whence  {r„,  n  >  1}  is  well  defined  as  was  shown 
in  Proposition  5. 

In  Proposition  5,  replace  e  by  ebn  for  each  n  >  1.  Then,  for  arbitrary  e  >  0 

r  sup  IT,- 1 


P^ 


h >^ 

On 


'     <     ^^EEd^il")  (0<C7„(p)<2) 


-^    0  (by  (3.2.1)) 

thereby  proving  (3.2.2).  □ 

Corollary  5.  Under  the  hypotheses  to  Theorem  3,  the  tail  series  WLLN 

K 

obtains. 

Proof.  The  corollary  follows  immediately  from  (3.2.2).  □ 

As  additional  corollaries  of  this  theorem,  we  obtain  the  following  two  tail  series 
WLLNs  (Corollaries  6  and  7)  for  the  weighted  i.i.d.  case. 

Corollary  6.  Let  {F„,  n  >  1}  6e  i.i.d.  random  variables  with  E(Fi)  =  0,  E{Yi)  = 


^      i        '  '.  '  ^:^^J 
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1,  and  let  {a„,  n  >  1}  be  a  sequence  of  nonzero  constants.  If  the  series  ,,  -~: 

oo  ■  .  ■ 

E«n<oo,  '■'      (3.2.3) 

n=l 

then  setting 

oo 


j=n 


/or  every  o;  >  0  and  positive  integer  r,  the  tail  series  WLLN 

^ Lo 

obtains. 

Remark.  The  condition  (3.2.3)  is  necessary  for  {r„,  n  >  1}  to  be  a  well-defined 
sequence  of  random  variables  where  Tn  =  J^'^nO.jYj,  n  >  1  (for  clarification  see 
the  discussion  in  Section  4.3  of  Chapter  4). 

Proof  of  Corollary  6.  Let  a  >  0  and  let  r  be  positive  integer.  Set 

Since  (3.2.3)  ensures  that  t"^  J,  0, 

1    °°  t^  1 

tfS  ^<'"' "^''^ = ^To^ifo" = (i;;i:«"  ^  ° 

and  so  (3.2.1)  holds  with  p  =  2  where  Xn  =  OnKn  n  >  1.    The  corollary  then 
follows  directly  from  Theorem  3.  □ 

As  a  special  case  (r  =  2  and  a  =  1)  of  Corollary  6,  we  obtain  the  following 
corollary  which  will  then  be  compared  with  a  tail  series  LIL. 
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Corollary  7.  Under  the  hypotheses  to  Corollary  6,  the  tail  series  WLLN 

sup|E~,a,r,| 

^ -^  0  (3.2.4) 

tn{\og,t-^y 

obtains. 

The  hypotheses  of  Corollary  7  (or  Corollary  6)  are  weaker  than  those  of  some 

results  of  Rosalsky  [41,  Theorems  2  and  3]  which  provided  conditions  for  the  tail 

series  LIL 

lim  sup ^~"    ^    \  =  V2  a.s.  (3.2.5) 

"-~    tn{\og,t-^)^ 

to  obtain.  Observe  that  the  norming  constants  in  (3.2.4)  and  (3.2.5)  are  the  same. 

The  following  two  examples  exhibit  a  sequence  of  norming  constants  {6„ ,  n  >  1 } 
for  which  a  tail  series  WLLN  holds,  but  a  tail  series  SLLN  does  not.  In  the  first 
example,  the  harmonic  series  with  a  random  choice  of  signs,  which  was  considered 
in  Example  3  of  Chapter  2,  will  be  reconsidered. 

Example  4.  Let  {Xn,  n  >  1}  be  independent  random  variables  such  that 

Let  0  <  o:  <  1.  Then  for  arbitrary  p  e  (0, 2] 

E(|Xnr)  =  n-P,  n>l. 
Let  r  be  a  positive  integer,  and  set 

K  =  n-2(log,.n)^,  n  >  1. 
Then 

Tv =  -ZTT] 72£  =  n    '  (logr  ")     ' 

On  n   2  (log,  n)  2 
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implying 


oo 

_E  /,  \-2E 


nssl  *'»»  n=l 

Hence,  since  p  €  (0, 2]  is  arbitrary,  the  hypotheses  of  Proposition  6  are  not  met. 

Indeed,  it  will  be  seen  below  that  for  p  =  2,  r  =  2,  a  =  1,  {Xn,  n  >  1}  obeys 
the  tail  series  WLLN  with  norming  constants  {6„,  n  >  1}  but  does  not  obey  the 
tail  series  SLLN  with  those  norming  constants  (since  it  obeys  the  tail  series  LIL 
with  those  constants). 

Next,  choose  p  =  2.  Then 

00  00    1         1 

i=n  j=n  J  " 

Thus  for  r  >  1  and  a  G  (0, 1], 

1    °°                          n~^                     1 
—  ^  E(X|) — — — ■  = —  =  0(1) 

ensuring  (3.2.1).  By  applying  Theorem  3,  the  tail  series  WLLN 

sup  IT,- 1 

'-"  ^-f  0,  (3.2.6) 


n   2  (log,,  n)  2 
obtains.  Choosing  r  =  2  and  a  =  1,  it  follows  in  particular  that 


sup  IT,  I 

'-"  ^.0.  (3.2.7) 


n   2(log2n)2 

(Note  that  {Xn,  n  >!}  are  weighted  i.i.d.  random  variables,  i.e.,  Xn  =  a„  Ki,  n  > 
1,  where  {V^,  n  >  1}  are  i.i.d.  random  variables  with 

P{F„  =  l}  =  P{r„  =  -l}  =  i,  n>l 
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and  a„  =  n~^,  n  >  1.  Thus,  by  applying  Corollary  6  and  Corollary  7,  we  can  also 

arrive  at  the  same  conclusions  (3.2.6)  and  (3.2.7),  respectively.)  But,  recalling  the 

tail  series  LIL  (2.4.14)  of  Example  3  of  Chapter  2,  it  is  clear  that  the  tail  series 

SLLN 

T 
i — ^  U  a.s. 


n  a(log2n)2 


fails. 

Next,  an  example  constructed  by  Rosalsky  [41,  Example  1]  of  weighted  i.i.d. 
random  variables  will  be  discussed  in  the  context  of  the  tail  series  WLLN  and 
SLLN. 

Example  5.  Let  {Ki,  n  >  1}  be  i.i.d.  random  variables  with  E(Fi)  =  0,  ^{Y^)  = 
1.  For  each  n  >  1,  let 

2  ^  (log2»)"(log3»)" 

"       n  exp  {(log,  n)  (log,  nf  {log,  n)"} '        °°  <  «'  "  <  ~ 

and  assume  that  if  u  >  1 ,  then 

^{Y^  (log2  iFil)')  <  oo  for  some  q>u-\. 

Then  the  condition  (3.2.3)  obtains  (see  Rosalsky  [41,  Example  1]).  Then,  for  r  > 

1  and  a  >  0,  the  tail  series  WLLN 

sup|E~ia.K| 

^, 77^  -^  0,  (3.2.8) 

obtains  by  Corollary  6.  By  choosing  r  =  2  and  a  =  1  (or  by  Corollary  7),  it  follows 

in  particular  that 

sup|E~,.a,y^| 

^ ^^0. 


^'"B' 
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But  by  Rosalsky  [41,  Example  1],  the  tail  series  LIL 

limsup J-  =  V2  a.s 

obtains.  Thus  the  tail  series  SLLN 


0  a.s. 


fails. 


Remark.  It  may  be  noted  that  the  hypotheses  to  the  tail  series  LILs  of  Rosalsky 
[41,  Theorem  2  and  3]  ensure  immediately  via  the  Chebyshev  inequality  that 

T 


<n(log2<-2)? 

Indeed,  the  hypotheses  to  these  theorems  of  Rosalsky  [41]  always  entail  the  stronger 
conclusion 

sup  it;- I 


This  observation  was  already  made  after  Corollary  7  concerning  the  tail  series  LIL 
of  Rosalsky  [41,  Theorems  2  and  3].  Apropos  of  Rosalsky  [41,  Theorem  1],  the 
observation  follows  immediately  from  our  Theorem  3  by  taking  p  =  2  and  i„  — 
in{log^t-^)K  n>l. 
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CHAPTER  4 
TAIL  SERIES  STRONG  LAWS  OF  LARGE  NUMBERS  II 


4.1     Introduction  and  Preliminaries 

As  was  discussed  at  the  end  of  Chapter  2,  there  is  a  gap  between  the  conclusion 
of  our  tail  series  SLLN  (Theorem  2)  and  that  of  the  tail  series  LIL  of  Rosalsky  [41, 
Theorem  2].  So,  it  is  natural  to  seek  a  tail  series  SLLN  whose  conclusion  is  more 
akin  to  that  of  the  tail  series  LIL  of  Rosalsky  [41,  Theorem  2].  To  this  end,  we  will 
establish  in  Theorem  4  below  a  tail  series  counterpart  to  the  following  SLLN  for 
partial  sums  by  Teicher  [47]. 

Proposition  7  (Teicher  [47]).  Let  1  <p<2  and  let  Sn  =  Ei=i  ^j,  n>l,  where 
{Xm  n  >  1}  are  independent  random  variables  with 

E(X„)  =  0,  E{\Xnn  <  e„  <  00,  BP  =  X^e,-  -^  oo,  n  >  1 

where  {e„,  n  >  1}  are  positive  constants.  Assume  that 

Bn+l  =  0(B„). 

If  for  some  a  €  [0,  M  and  some  positive  constants  8  and  e 

oo 

53  P{|X„|  >  8B^  (log2  B„)^-"}  <  oo  (4.1.1) 

n=l 

and 

(B„     log^Bn^     ") 


n=l 
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then  the  SLLN 

P    ,,    ^  ,, >  0  U.S.  (4.1.3) 

Remark.  A  standard  Borel-Cantelli  argument  reveals  that  (4.1.1)  is  a  necessary 
condition  for  the  conclusion  (4.1.3)  to  obtain.  Moreover,  while  the  condition  (4.1.2) 
is  technical  in  nature,  it  is  not  at  all  ad  hoc  in  that  it  is  of  the  spirit  of  conditions 
employed  by  Chow,  Teicher,  Wei,  and  Yu  [15],  Egorov  [19,  20],  Heyde  [22],  Klesov 
[31],  Petrov  [37]  (see  Heyde  [22]  and  the  inequality  (I)  of  Loeve  [34,  p.  209]  for  clar- 
ification), Petrov  [40,  p.  303],  Sakhanenko  [42],  Teicher  [45,  46],  Tomkins  [48],  and 
Wittmann  [50]  to  prove  LILs  (or  SLLNs)  for  partial  sums  of  independent  random 
variables.  Moreover,  the  above  authors  also  employed  a  condition  in  the  same  spirit 
as  (4.1.1). 

It  will  be  seen  after  the  statement  of  Theorem  4  that  this  theorem  will  yield  a 
sharper  result  than  that  of  the  tail  series  SLLN  of  Theorem  2  of  Chapter  2  when 
the  hypotheses  of  Theorem  4  are  satisfied.  Furthermore,  as  special  cases  of  the  tail 
series  SLLNs  of  this  chapter,  we  will  investigate  the  tail  series  SLLN  problem  for 
weighted  sums  of  i.i.d.  random  variables.  In  the  weighted  i.i.d.  case,  it  will  also  be 
seen  after  the  statement  of  Theorem  5  that  this  tail  series  SLLN  will  narrow  the 
gap  between  the  conclusion  of  the  tail  series  SLLN  and  that  of  the  tail  series  LIL 
of  Rosalsky  [41,  Theorem  2]. 
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4.2     Tail  Series  SLLNs 

For  independent  random  variables  {X„,  n  >  1}  we  obtain  tail  series  SLLNs 
below,  which  are  counterparts  to  the  SLLNs  for  partial  sums  of  Teicher  [47].  The 
main  result  of  this  chapter,  Theorem  4,  may  now  be  stated.  As  in  previous  chapters, 
{Tn,  n  >  1}  denotes  throughout  the  tail  series  r„  =  jy^n  ^h  "  ^  l?  corresponding 
to  random  variables  {X„,  n  >  1}.  It  will  be  shown  in  the  proof  of  Theorem  4  that 
the  hypotheses  guarantee  that  {r„,n  >  1}  is  a  well-defined  sequence  of  random 
variables.  But,  the  proof  of  Theorem  4  will  be  deferred  until  after  the  proof  of  the 
ensuing  Lemma  10. 

Theorem  4.  Let  1  <  p  <  2  and  let  {X„,  n  >  1}  6e  independent  random  variables 
with 

E(A:„)  =  0,  E(|X„n<e„,  n>l 

where  {e„,  n  >  1}  are  positive  constants  with  Yl'^zzi  e„  <  oo.  Assume  that 

Al  =  0{Ai^,)  (4.2.1) 

where  A^  =  YlJLn  ^h  ■ri>l.  If  for  some  a  E  (-cx),  -) 

oo 

J2  P{l^n|  >SAn  (log2  ^7)'-°}  <  OO  for  some  6>0  (4.2.2) 

n=l 

and  for  all  e  >  0 

~    ^\^[.A„{[og^A-'')-''<\X„\<SA„(log^A-''y-<']) 

2-/ } 72 <  °°>  (4.2.3) 

{A^ilog^Any-") 


n=l 

then  the  tail  series  SLLN 


T 

0  a.s.  (4.2.4) 


Ar,{\og^Any-" 
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obtains. 

Remarks,  (i)  Note  that  (4.2.1)  ensures  that  A~^An+i  >  7  for  some  7  G  (0, 1). 

(ii)  Note  that  if  {X„,  n  >  1}  satisfies  the  hypotheses  to  Theorem  4,  then  the 
hypotheses  to  Theorem  2  of  Chapter  2  are  also  satisfied  with 

5„  (x)  =  Ixl",  1  <  p  <  2,  n  >  1 

and  so  for  any  il>{x)  G  ^ 

i — >  0  a.s. 


-i^ip 


where 

00 

j=n 

As  for  as  notation  is  concerned,  note  that  if  {Xn,  n  >  1}  obeys  the  hypotheses  to 
Theorem  4  with  e„  =  E(|X„|p),  n  >  1,  then  the  sequence  {An,  n  >  1}  of  Theorem 
4  is  in  fact  the  sequence  I  An,  n>l\.  However,  in  this  case, 

(iog,^7)^-"  =  o((V'M;^))p) 

whence  Theorem  4  yields  a  sharper  conclusion  than  does  Theorem  2.  Of  course, 

(a)  in  general,  the  hypotheses  of  Theorem  2  may  be  satisfied,  but  not  those  of 
Theorem  4, 

and 

(b)  Theorem  2  involves  a  class  of  norming  sequences  which  is  structurally 
different  from  that  of  Theorem  4. 

As  will  become  apparent,  Theorem  4  owes  much  to  the  work  of  Teicher  [47].  The 
proof  of  Theorem  4  utilizes  the  following  two  lemmas.  In  Lemma  9,  there  are  no  as- 
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sumptions  concerning  the  integrability  of  the  random  variables  exp{t  S},  exp{t  Sn}, 
n  >  1,  in  (4.2.5).  Moreover,  Lemma  9  cannot  be  proved  by  invoking  the  continuity 
theorem  for  moment  generating  functions  unless  5„,  n  >  1  and  S  are  all  defined  on 
a  common  interval  of  the  t-axis  containing  0  as  an  interior  point. 

Lemma  9.  Let  5'„  =  Yl^=i^ji  J^  ^  1?  where  {Xn,  n  >  1}  are  independent  ran- 
dom variables  with 

oo 

E{X„)  =  0,  n  >  1,  and  J^  E{Xl)  <  oo. 

n=l 

Then  there  exists  a  random  variable  S  with  E(5)  =  0,  Var(5')  =  I^^i  E(A'^)  and 
5„  — >  5  a.s.  and  such  that 

\imE[exp{t Sn})  =  E(exp{f 5}),  -oo<t<oo.  (4.2.5) 


Proof.  The  existence  of  a  random  variable  S  with  E{S)  =  0,  Var(5)  =  E~=i  ^K) 
and  Sn  —^  S  a.s.   follows  directly  from  the  Khintchine-Kolmogorov  convergence  the- 


orem. 


Next,  for  all  n  >  1,  Jensen's  inequality  ensures  that 

E(exp{<r„+i})  >  exp{tE{Tr,+i)}  =  e°  =  1 

and  so 

E(exp{i5'})     =    E{exp{tTn+i}exp{tSr,}) 

=    E\exp{tTn+i}jE\exp{t Sn})  (by  independence) 
>    E(exp05„}).  ■  ^  -       ' 


^1 


1 5 
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Thus, 

limsupE(exp{<5„})  <E(exp05'}).  (4.2.6) 

n— ►oo  ^  '  *■  '  ; 

\ 

Moreover, 

E(exp{^5})     =    EQhnexp{t5„}] 

<    liminf  Efexp{f  S'n}]  (by  Fatou's  lemma) 

which  when  combined  with  (4.2.6)  yields  the  conclusion  (4.2.5).  □ 

Lemma  10.  Lti  {Xn,  n  >  1}  6e  independent  random  variables  with  \Xn\  < 
Mn,  n  >  1,  where  {A/„,  n  >  1}  is  a  bounded  sequence  of  positive  constants  and 
suppose  that 

E(X„)  =  0,  n  >  1. 

(i)  //  the  series 


E  ^n  <  °o,  (4.2.7) 

n=l 

where  a^  =  E{Xl),  n  >  1,  then  setting 

oo 

the  inequalities 


obtain  for  all  t  €  (0,  C„  ^]  where 


Cn  =  — supMj,  n  >  1. 

^n  j>n 


-.:    -y 
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(ii)  In  addition  to  the  assumptions  in  part  {i),  let  {x„,  n  >  1}  be  a  numerical 
sequence  satisfying 

0<  C„x„  <M,  n>  1  (4.2.8) 

for  some  constant  u  <  cx).  Then  the  inequalities 


plsupr,  >  Ax„<„|  <  exp|-x^^t;A  -  y (l  +  ^ 


^       --(1  +  — ))^">1 

obtain  for  all  X  >  0  and  all  v  €  (0,  u"^]. 

Remark.  Observe  that  our  A  in  part  (ii)  may  vary  with  n,  i.e.,  the  above  A  can 
be  replaced  by  A„. 

This  lemma  is  a  tail  series  analogue  of  the  exponential  bounds  lemma  of  Teicher 
[47,  Lemma  1].  The  proof  of  Lemma  10  employs  the  function  2~^  (1  +  2~^x)  playing 
a  similar  role  as  the  function  g  (x)  =  x"^  (e^^  -  1  —  x)  of  Lemma  1  of  Teicher  [47]. 

Proof  of  Lemma  10.  (i)  The  argument  is  contained  in  the  proof  oi  Theorem  2  of 
Chow  and  Teicher  [13]. 

(ii)  In  order  to  prove  part  (u)  of  the  lemma,  we  will  employ  the  argument  in 
the  proof  of  Proposition  5  of  Chapter  3.  As  in  the  proof  of  Lemma  7  of  Chapter  3, 
note  that  the  hypotheses  ensure  that,  for  a  given  n  >  1,  {Sn,M,  ^n,M,  M  >  n}  is 
a  martingale  where 

M 

Sn,M  =  5Z  ^J'    -^^M  =  (^{^n,    •",   Xm),    M  >  n  >  1 
j=n 

and  so  for  t  >  0,  jexpj^  Sn,M\,  ^n,Mi  -^  >  '^j  is  a  submartingale  (see,  e.g.,  Chow 
and  Teicher  [14],  p.  232)  since  the  function  ip{s)  =  exp|^5}  is  convex.  Then  for 
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iV  >  n  >  1,  u  e  (0,  u  ^],  and  t  =  v  Xn,  we  have 

P  i  ^^\r  T'i  >  A  x„  <„  I    =    P  {  max    lim  [T  AT,  >  A  x„  <„  I 


=      P 


{lim    ] 
Af  — ►oo  n 


M 


n^n  } 


=    EI 


max  y^X-  >  Ax 
■<i<jv  f-f 

— '-    »=j 


lim   maxY'^  Xi>Xxntn\ 


=    E    liminfl 


A/— ►oo 


<    liminfEll 

Af— ►oo 


max  T,^,Xi>Xx„t„ 


max  y;.^.Xi>Ax„t„ 


(by  Fatou's  lemma) 


M 


=    lim  inf  P  <   max  ^Xi  >  X  x„  f „ 

Af— »oo  I  n<j<N  T^. 

{M 
n<j<Al  T^ 

=    liminf  pi  max  exp{—  Sj,m)  >  exp{—  A  x„  <„}  i  (<>  0) 

JW-too         Ln<j<Af  tn  In  J 

,      E(exp{f  5„,m}) 

<    liminf— ^^ V"x     \ 

A/-»oo        exp{<Ax„) 

(by  Doob's  submartingale  maximal  inequality  [18,  p.  314]) 


exp{<Ax„} 
<    expj-Ux„  +  — r 


(by  Lemma  9) 


1  + 


(  by  part  (i):  note  t  €  (0,  C„-^]) 
=    exp|-vAx^  +  -u2xMl  +  -ux„C„j| 
<    exp|-x^  ^,  A  -  ^  (l  +  ^))  I  (by(4.2.8)). 
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Letting  N  —^  oo  yields 

FisupTj  >  Xxntn}     =      lim    P<   max  Tj  >  XXntn} 

{j>n  )  iV-»oo        Kn<j<N  J 

<    exp{-xj(„A-^(l  +  ^' 

thereby  proving  the  lemma.  D 

Proof  of  Theorem  4.  Observe  at  the  outset  that  the  tail  series  {r„,  n  >  1}  is  well 
defined  by  taking  gn  (x)  =  |x|p,  n  >  1,  in  Theorem  2  of  Chapter  2.  (Alternatively, 
with  the  above  choice  of  {gn{x),n>  1},  Loeve's  [34,  p.  252]  generalization  of  the 
Khintchine-Kolmogorov  convergence  theorem  ensures  that  {Tn,n  >  1}  is  a  well- 
defined  sequence  of  random  variables.) 

Let  e  >  0  be  arbitrary  and  let  0  <  a  <  -,  For  each  n  >  1  set 

—  p  — 

Un  =  Xn  I[|^„|<^A„(log,>l-'')-o] 
Wn  =  ^nI[e^„(log^^-P)-<.<|jf„|<5,l„(log^^-'')i-a]- 

Then  X^  =  f/„  +  K  +  W^,  n  >  1.  Now,  for  each  ;  >  n  >  1, 

E(|V^|)    <    ^[\XA\sMlog,A-'-v-<'<\x,\<AAlog,A-'')-<']) 

<    A„  (log2  A-^-"  P{\Xj\  >  SAj{\og,  A-^y-'^} 

+  <-  (log,  A-)«(-^)  E(|x,r  i[„,,,„aog.  A,n-]) 

and  so 

oo  oo 

\j:nVj)\    <    A^{\og,A:n-''Y:P{\Xj\>6Aj{log,A-n'-} 


J=n  ]=n 
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=    o(^„  (log2  AZ^y-")  (since  ap  <  1),  (4.2.9) 

using  (4.2.2)  and  the  fact  that 

Note  that  (4.2.2)  ensures  via  the  Borel-Cantelli  lemma  that  a.s.  Vn  is  eventually  0 
and  consequently  so  is  YlJLn  ^j-  Thus 

^=^^^ .  0  a.s. 

A„  {log,  An'y-'' 

implying  via  (4.2.9)  that 

.    ,, rr^r:; >  0  a.s.  (4.2.10) 

Ar^ilog^An^y-" 

In  view  of  (4.2.3)  and  Khintchine-Kolmogorov  convergence  theorem 

>    ; -7 converges  a.s. 

Then  by  applying  Lemma  1  of  Chapter  2  to  this  we  obtain 

ET=n{Wj-E{W^)} 

■    ,, rr^T-; »  0  a.s.  (4.2.11) 

A,,  {log,  An^y-"' 

Now,  observe  that  E{Xn)  =  E(C/„)  +  E(K)  +  E(Wn)  =  0.    Then,  in  view  of 

(4.2.10)  and  (4.2.11),  in  order  to  show  that  (4.2.4)  holds,  it  suffices  to  show  (since 

e  is  arbitrary)  that  Rn  =  YlJLn  {^i  ~  E(f^j)},  n  >  1,  is  a  well-defined  sequence  of 

random  variables  satisfying 


\Rn\  ^   65 

"n^^^o^"    An  (log2  An^y-"   "    7^ 


'^ 


•■>; 


^i"^^"P    .    n.:    ,-P,r-c^ZI^-'-  '    (4-2.12) 


where  0  <  7  <  1  is  as  in  Remark  (i)  after  the  statement  of  the  theorem. 
To  this  end,  firstly  observe  for  each  n  >  1  that 

E(ic/„ - E([/„)n  <  E((if/„i+|E(t/„)in  .-..  ■  ■, 

<  2''{E(it/„r+iE(t/„)n} 
=  2ME(if/„n+iE(£/„)n 

<    T>{E{\UrX)  +  Edf/nl")}  (by  Jensen's  inequality) 

=  2''+^E(n/„n 

and  so 

00  00  00 

$:  E(ic/„  -  E(i/„)r)  <  Y.  2"+^  E(itA„r)  <  2"+^  e  ^n  <  oo. 

n=l  n=l  n=l 

Thus,  by  taking  5r„  (x)  =  |x|'',  n  >  1,  via  Theorem  2  of  Chapter  2,  {i2„,  n  >  1}  is 
a  well-defined  sequence  of  random  variables. 

Next,  recalling  that  ^^  >  7  where  0  <  7  <  1,  let 

Uk  =  inf  |n  >  1  :  A„  <  7*},  k>l. 

Then,  for  all  k  such  that  Uk  >  2,  since  v4n*-i  >  7*, 


>l„*>7>ln*-i>7*"^'>  A 


»*ik+l  • 


Hence  {n^,  A;  >  1}  is  a  strictly  increasing  sequence  of  integers.   Moreover,  for  all 
k  >2  such  that  n^  >  2,  since 

An*  >  7^"^'  and  An,_,  <  7*"', 


it  follows  that 


A  -7*^+^ 

:r^  >  3:r  =  T^  (4.2.13) 


66 


For  each  n  >  1 , 

p|/?n  >  ^Ar, {log,  A-^y--  i.o.(n)| 

<      P(     sup      Rr^>^Ar.,{\0g,A:^y"'l0.{k)] 

<    p|   sup    R^>6eAn,_J\og,A-^   Y~"  i.o.{k)\ 

l.n>n*-l  J 

(by  (4.2.13)  and  the  fact  that  A-p  t  as  jfc  j) 
=    P|  sup  iZn  >  eeAr,J\og,A-^y~"  i.o.  (A:)l.  (4.2.14) 

Now,  for  each  n  >  1,  let  r^  =  E(i?2).  Then 

rl    <    T>^{x]ll^x,\<,A,(\og,A-'')-<']) 

=      T,^[\^j\'W~'\\X,\<.AA\og,A-n-'']) 


-    (log,A„->(-.)g^('^^l'^ 


£^-M„^ 


(log2A;'')«(2-P) 

For  each  n  >  1,  note  that,  since  |t/„|  <  £>!„  (logj  A~'')~°', 

\Un  -  E{Un)\  <  2eAn  (log^yl;")-"  =  Mn,n>  1. 
Then,  for  each  n  >  1,  setting 

^n  j>n  r„  r,i 

eeAl  {log,  A-r>y-''^ 


A„  = 


''^ 


r„(log2A-'')^ 

a;n  =  — 


(4.2.15) 


An 
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it  follows  that 


Cn»a;n*=2e  (4.2.16) 

'^n.xn.rn,  =6eA„,(log2/l;p)'""  (4.2.17) 

Kxl^  =  6£  (log2  A-^)  ^  oo  (4.2.18) 


<  =  '"^^"^'."^"^      <  ^'-'  (log2  A-jr  =  o(log,  A-J)       (4.2.19) 


n* 


by  (4.2.15)  and  the  fact  that  ap  <  I. 

Now  by  (4.2.14)  and  (4.2.17)  we  obtain 

pUn  >  ^Ar^ilog.A-n'-"  i.o.(n)|  <  pjsup  Rn  >  A„,x„,r„,  i.o.(A;)|. 

(4.2.20) 
But,  for  all  fe  >  2  such  that  Uk  >  2,  letting  u  =  2e  and  v  e  (0, u~^],  we  have 

(  by  part  (u)  of  Lemma  10  recalling  (4.2.16)) 
=    exp{-3(log,A„7)+/^<}(/^  =  ^) 

(  by  taking  i;  =  ^  and  by  (4.2.18)) 
<    exp{-2(log2/l;,'')}(  by  (4.2.19)) 
=     (logxA-)' 


,-2 


<    {-pklogi  7)      (  since  A'^  >  7"^*=) 


and  so  for  some  constant  C  €  (0,  00) 

00      j-                                    -j                        1  °°    1 

J3  P{  sup  K  >  A„,x„,r„,  \<C+  — n rr  J2  T. 


p<°°- 
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Hence,  by  Borel-Cantelli  lemma, 

P^  sup  Rn  >  A„^i„^r„^  i.o.(A:)  \  =  0 
U>n*  J 

implying  via  (4.2.20)  that 

pIr.  >  ^  A„  (log2  AZ^y-"  i.o.(n)|  =  0. 

Hence 

hm  sup  — ^  <  —  a.s.  4.2.21 

n^<x>      A„  (log2  v4„'')l-«  72  ^  ^ 

Since  {  —  {Un  —  E(C/„)),  n  >  1}  have  the  same  bounds  and  variances  as  those  of 
{{Un  -  E(f/„)),  n  >  1},  (4.2.21)  likewise  obtains  with  -Rn  replacing  Rn  thereby 
proving  (4.2.12)  and  the  theorem.  □ 

By  taking  p  =  2  in  Theorem  4,  we  obtain  the  following  two  corollaries  which  are 
partial  analogues  of  Teicher's  [47]  corollaries  of  Proposition  7  above. 

Corollary  8.  Let  {Xn,  n  >  1}  be  independent  random  variables  with 

00 
E{Xr.)  =  0,  E{Xl)  =  cTln>  1,  and  tl  =  Y:<t]  =  o{l) . 

j=n 

Assume  that 

tl  =  0{tl^,).  (4.2.22) 

If  for  some  a  E{— 00,  |) 

00 
J2  P{l^n|  >  St„{\og^  t^y-"}  <  00  for  some  S>0  (4.2.23) 

n=l 

and  for  all  e  >  0 

~  ^[^n\t„(\og,i;:')-''<\x„\<st„(\og,t-y-<']) 
2^  — 7 72 —  <  oo>  (4.2.24) 


:^, 
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then  the  tail  series  SLLN 

„     ^"  ,„ ^  0  a.s.  (4.2.25) 

obtains. 

Remark.  Observe  that  this  corollary  precludes  a  =  |.  In  fact,  the  conditions 
(4.2.23)  and  (4.2.24)  when  a  =  |  comprise  two  of  the  three  conditions  for  the  tail 
series  LIL  of  Rosalsky  [41,  Theorem  2]. 

Corollary  9.  Let  {X„,  n  >  1}  be  independent  random  variables  with 


E(X„)  =  0,  E{Xl)  =  cTln>  1,  and  tl  =  '£<^-=o (1) 

If  for  some  a*  G  (0,  |]  and  M  G  (0,  cx)), 

l^nl  <  M^„(log2C')""'  a.s.,  n  >  1,  (4.2.26) 

then  the  tail  series  SLLN  (4.2.25)  prevails  for  all  a  <  a*. 
Proof.  For  a*  G  (0,  |],  observe  at  the  outset  that 
t^  0-2 

{H2tn'y"' 

-^    1  (since  ^2  =  o(l)) 

and  hence  (4.2.22)  holds.    Note  that  (4.2.26)  ensures  that  the  conditions  (4.2.23) 
and  (4.2.24)  hold  for  any  a  <  a*.  The  corollary  then  follows  from  Corollary  8.  □ 

The  two  conditions  (4.2.2)  and  (4.2.3)  of  Theorem  4  will  now  be  combined  into 
a  single  one  in  the  next  two  Corollaries  10  and  11  which  are  comparable  with  the 


tail  series  LILs  of  Rosalsky  [41,  Corollaries  1  and  3].  That  is,  a  condition  which 
ensures  that  the  conditions  (4.2.2)  and  (4.2.3)  are  simultaneously  satisfied  will  be 
employed  in  each  of  the  following  two  corollaries. 

Corollary  10.  Let  1  <  p  <  2  and  let  {X„,  n  >  1}  be  independent  random  vari- 
ables with 

E(X„)  =  0,  EdX^I")  <  e„,  n  >  1 

where  {e„,  n  >  1}  are  positive  constants  with  Y^'^=i  ^n  <  oo-  Assume  that  (4.2.1) 
holds  where  A^  =  X^°l„  Cj,  n  >  1.  Let  -oo  <Q<1  andO  <fi  <1.  If  for  all  e  >  0 


,2/9 


<  OO,  (4.2.27) 


n=l  {An{\og,An''y-''y 

then  the  tail  series  SLLN  (4.2.4)  obtains. 

Remarks,  (i)  Observe  that  a  smaller  a  gives  us  a  weaker  assumption  (4.2.27)  as 
well  as  a  weaker  conclusion  (4.2.4). 

(ii)  Also  observe  that  for  ^  =  0,  the  condition  (4.2.27)  reduces  to 

f;  P{\Xn\  >  £  A„  (log2  >ir)-"}  <  cx)  for  all  e  >  0 

n=l 

and  for  ^  =  1,  it  becomes 


<  OO. 


n=i       {An{\og,A;;y-) 

Proof  of  Corollary  10.  Note  that  for  all  large  n 


2/3  -  / :  „      ;_„;,    \2p 


(A„  (log2  An'y-'')  ~  (A„  (log2  ^n'')^-'^)  ' 

^      ^\}[\X„\>A„(\og^A-''y-']) 

=    P{\X„\>A,{\og,A:n'-''}. 


-^1 
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Then  for  some  constant  C  €  (0,  oo), 


oo 

$:P{l^n|>A„(log,A7)^-«} 
n=l 


2/3 


<  c'  +  E 

n=i       (>i„(iog2yi;:'')i-") 

<    oo  (by  (4.2.27)) 


implying  the  condition  (4.2.2)  with  ^  =  1. 

Next,  note  that  for  arbitrary  £  >  0  and  all  n  >  1 

(A^log^AiT")!-")''' 

^        ^(l^"l^      ^[g^n(l0g,yl-'')-°<|A-n|<>ln(l0g,A-P)»-<']j 

^\\Xn\^    '^  ^[.>l„(l0g3>t-'')-<|A-n|<>tn(l0g,>t-'')>-']j 

^        ^V^nI[tAn(l0g,>t-'')-''<|Xn|<>tn(l0g,A-P)l-']j 

(^^(log^A;:'')'-")' 


Then 


oo 


E 


^(-^nI[e>l„(log^^-P)-a<|A-„|<>t„(log^yl-'')l-a]j 

ntl  (A„(iog2>i;r'')'-")' 

^         ~     E(^|Xn|^^  I[|Xn|>e>ln(l0g,>l-'')-a]  j 

n=i       (yi„(iog2A;r'')i-«)'^ 

<    OO  (by  (4.2.27)) 


and  so  the  condition  (4.2.3)  also  holds  with  ^  =  1.    The  corollary  then  follows 
directly  from  Theorem  4.  □ 
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Corollary  11.  Let  1  <  p  <  2  and  let  {Xn,  n>\}  be  independent  random  vari- 
ables with 

E(X„)  =  0,  E(|X„n<e„,  n>l 

where  {e„,  n  >  1}  are  positive  constants  with  Yl'^=i  ^n  <  oo-  Assume  that  (4.2.1) 
holds  where  A^  =  Ej^„  Cj,  n  >  1.  Lef  -c»  <  a  <  ^,  an<i  7  >  1.  ///or  a//  e  >  0 

f/ien  f/ie  tail  series  SLLN  (4.2.4)  obtains. 

Proof.  Note  that  for  arbitrary  £  >  0  and  all  large  n,  (4.2.28)  ensures  that  for 
some  constant  Ci  €  (0,  cxj) 

^[\^^\''\\Xr,\>cA„{\og,A-'')-''])  ^       e_^ 

(A„  (l0g2  An''y-<'y  -       '  Al  (log,  A-J)  (log,  An')  (log3  AiT")^  ' 

Then  for  some  constant  C2  G  (0,  cx)) 

„=i       [An  (logj  a;:'')^"") 

00 

<  C2  +  c^Y. 


tx  A^n  (logi  A7)  (log,  AiT")  (iog3  ^i;:")^ 

<    00  (by  Rosalsky  [41,  Lemma  5]) 

and  so  the  condition  (4.2.27)  holds  with  ^  =  \.   The  corollary  then  follows  from 
Corollary  10.  □ 

4.3     The  Weighted  LLP.  Case 

For  i.i.d.  random  variables  {F„,  n  >  1}  with  E(yi)  =  0,  ^{Y^)  =  1,  and  for 
nonzero  constants  {an.,  n  >   1},  {a„yii,  n  >  1}  is  a  sequence  of  weighted  i.i.d. 
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random  variables.  Then  there  exists  a  random  variable  5*  with  I3?=i  Oj  Yj  —y  S  a.s. 
iff  H^i  '^n   <   °°-  (Sufficiency  follows  directly  from  the  Khintchine-Kolmogorov 
convergence  theorem  whereas  necessity  results  from  the  work  of  Kac  and  Steinhaus 
[28]  or  Marcinkiewicz  and  Zygmund  [35]  or  Abbott  and  Chow  [1].)  In  such  a  case, 
EiS)  =  0,  EiS')  =  E~  1  al 

Corollaries  8  and  10  reduce  to  Corollaries  12  and  13  below,  respectively,  in  the 
weighted  i.i.d.  case. 

Corollary  12.  Let  {Yn,  n  >  1}  6e  i.i.d.  random  variables  with  E{Yi)  =  0,  E{Yi)  = 
1,  and  let  {a„,  n  >  1}  be  nonzero  constants  satisfying  t^  =  Y!,'jLn^^  —  ^(1)  ^"<^ 
(4.2.22).  If  for  some  a  €  (-oo,  |) 

oo 

Y,P{\Yi\>6  |a„|-'  <„  {log^t-y-"}  <  oo  for  some  S>0  (4.3.1) 

n=l 

and  for  all  e  >  0 

~    °n  ^[Y,^  ^[.|a„r»t„(log,t;r^)-<|Ki|<«|a„r't„(log,t-^)i-]  )  ^  _  ^^ 

2^ 7 ; — 72 <  c»>  (4-3.2) 

{tniiog.t-^r") 

then  the  tail  series  SLLN 


0  a.s.  (4.3.3) 


tniiog.t-^y- 

obtains. 

Proof.  Since  the  conditions  (4.3.1),  (4.3.2),  and  (4.3.3)  are  simply  transcriptions 
of  (4.2.23),  (4.2.24),  and  (4.2.25),  respectively  the  corollary  follows  immediately 
from  Corollary  8.  □ 

Corollary  13.  Lef  {F„,  n  >  1}  6e  i.i.d.  random  variables  with  E{Yi)  =  0,  E{Y^)  = 
1,  and  let  {a„,  n  >  1}  be  nonzero  constants  satisfying  <^  =  $3^„aj  =  o(l)  and 


p?.-- 
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(4.2.22).  Let  -oo  <  a  <  \  and  0  <  ^  <  I.  If  for  all  e  >  0 

2^ 7 r'T20 <  °°'  4.3.4) 

On  (log,  t-^)^-")' 


n=l 


f^en  the  tail  series  SLLN  (4.3.3)  obtains. 

Proof.  Since  the  condition  (4.3.4)  is  a  simple  transcription  of  (4.2.27)  with  p  =  2, 
the  corollary  follows  directly  from  Corollary  10.  Q 

The  main  result  of  this  section,  Theorem  5,  which  is  an  analogue  of  the  tail 
series  LIL  of  Rosalsky  [41,  Theorem  2],  may  now  be  stated. 

Theorem  5.  Let  {Yn,  n  >  1}  6e  i.i.d.  random  variables  with  E(Fi)  =  0,  E(Fi^)  = 
1,  and  let  {a„,  n  >  1}  be  nonzero  constants  satisfying  t^  =  Yl'jLn'^j  —  °(1)  ^^'^ 
(4.2.22).  // 

^  =  0  ((logj  t-y)  for  some  -oo  <  r  <  oo,  (4.3.5) 

then  the  tail  series  SLLN 

*n  (log,  t-2)^-   """•'• 

obtains  for  every  a  €  (— oo,  |)  provided  in  the  case  t  >  2(1  —  a)  that 

E(r,2(log,|n|)^-^(^-«))<oo.  (4.3.6) 


Remark.  Actually,  under  the  assumption  (4.3.5)  where  r  <  1,  the  result  follows 
directly  from  the  tail  series  LIL  of  Rosalsky  [41,  Theorem  2].  In  the  case  1  < 
T  <  2  (1  —  a),  the  additional  assumption  is  not  needed  in  Theorem  5,  although  an 
alternative  additional  assumption  in  the  same  spirit  eis  (4.3.6)  is  required  for  the 


'..^-   ■ 


.>^- 
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tail  series  LIL  of  Rosalsky  when  (4.3.5)  holds  with  t  >  1.  And  for  r  >  2  (1  —  a),  we 
assumed  the  moment  condition  (4.3.6)  which  is  weaker  than  the  additional  moment 
condition  in  the  tail  series  LIL  of  Rosalsky  since  r  —  2(1  —  a)  <  t  —  1.  -J 

Proof  of  Theorem  5.  Without  loss  of  generality,  it  may  be  assumed  that  r  >  0 
and  a  >  0.  Note  that  (4.2.22)  is  tantamount  to  t~'^t'f^_l  <  Mi  for  some  constant 
Ml  e  (0,  oo)  and  all  n  >  2.  Then  for  all  n  >  1, 

n    42 


J=2     -J 

implying 

log2C<(l+o(l))  login.  (4.3.7) 

Moreover,  for  all  large  j  and  for  some  constant  M^  G  (0,  oo),  observe  that 

42         -      ^  ■>"      42       /2 

<  1  +  M2^    ^.'  V       (by  (4.3.5)) 

<  i+2M,^i^^4^^(  by  (4.3.7)) 

J  -  1 


and  so  for  all  large  Mq  and  n>  uq 


Ino    -      TT    -2ri 

•■n  i=no+l     ""J 


<  n  (i+2M2(i-i)-^iogi(i-i))^) 

j=no+l 

<     nexp{2M2r'(logi;r} 

i=no 

=    exprX:2M2rMlog:;T| 

b=no  J 
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<  exp  1 2  M,  (log,  nYY^r'] 

(  j=no  ) 

<  exp{2M2(loginf+'}. 


Thus 


Xog^tl"  =  0{\og^n).  (4.3.8) 

In  view  of  Corollary  13,  it  is  suffices  to  show  that  the  condition  (4.3.4)  is  satisfied 
for  some  ^  G  [0, 1]  and  all  £  >  0.  Recalling  (4.3.5),  let  K  G  (0,  oo)  satisfy 

'^  <  K{\og,t-'y  (4.3.9) 

for  all  large  n.  For  each  n  >  1,  let 

where  £  >  0  is  fixed  but  arbitrary.  Then,  by  (4.3.9) 

<i^og,t-^y^' 


9n  <  „.n!?L..>  (4.3.11) 


and  also  by  (4.3.8)  and  (4.3.10) 

Iog2<;'  =  0(log2  9„).  (4.3.12) 

Next,  it  will  be  demonstrated  that  {qn,n  >  1}  is  eventually  nondecreasing  with 
9„  — >  oo.  To  this  end,  note  that 


na 


n-l 


tZ-l  (logl  t-1,)  (log2  t-1,)  tl  (logi  t-1,)  (log2  t-'_,) 

0(1)  (n-l)  at, 


(by  (4.2.22)) 


tl.i{^og,t-l,){\og,t-l,) 
=    o(l)  (4.3.13) 
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by  the  assumption  (4.3.5).    Let  <f>{x)  be  the  extension  of  {<~^,n  >  1}  defined  by 
linear  interpolation  between  integers,  i.e.,  for  all  n  >  2 

^(^)  =  C-i  +  (C'-C-i)(^-«  +  l),  xe[n-l,  n). 

Then,  via  the  mean  value  theorem,  for  all  large  n  there  exists  a  number  x„  in 
(n  —  1,  n)  such  that 

2        2        _  £^"  e^(n-l) 

'  j  1  (r  +  2a)  x„  {t-^  - 1-1,) 


e 

\T+2a 


K  [  (log2  <^  (x„))^+^"       <^(x„)  (logi  <A(x„))(log2  <^( 

=   ^(i  +  "(^))n      J  ,,.-^2.  (by  (4-3.13)) 

A  (log2<^(x„))   ^ 

>  ^  (log2  ^(:r„))-(^+^") 

>  0. 


Thus,  since  (4.3.10)  and  (4.3.8)  guarantee  ql  -^  oo,  we  have  verified  that  {g„,  n  >  1} 
is  eventually  nondecreasing  with  g„  ^  oo. 

Let  0  <  ^  <  1  and  r*  >  0,  the  exact  choices  of  which  will  be  made  later.  Then 


nsl 


-    ^i^)2^ 7^^ ._3.2ff(i-a)-/?r (by  (4.3.9)) 


n=l 

oo 


-  ^(1)2.-7^1 ■_2X^(2(l-a)-r)    (^y  (4.3.11)) 

n=in'^(log2^„2)^^  ^      ;    ; 

.  „.,.^Er=nE(iyxrib,<iy.i<,,,.]) 

-  ^  \tl       n^(log2^-)^(^(-")-^) 

oo  j 

=  0(1)  x:E(ir,r^i[,^<,y.i<,^,,])  $:  u-^(iog2^„-^)^(^-^(^-)) 

j=l  n=l 
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<  0(1)  Ei-'K  <7f  ""•-°»  E(|y,  r  ii„<,v,<«,) 

(by  Rosalsky  [41,  Lemma  6]) 

i=i  9i         (log2  9j) 

^  \t^^°^''  ^  (iog2  9.r 

(by  (4.3.10)) 


(by  (4.3.12)). 


<    0(1)  E  (log,  f-y+^°-^^-^-  E(r/(log,  \Y,\r  I(„<|n ,<,,,,])  (4.3.14) 


If  T  <  2  (1  -  a),  let  r*  =  0  and  /?  =  |(r  +  2a)  and  then  via  (4.3.14)  the  series 
of  (4.3.4)  is  dominated  by  0(1)  E{Y^)  <  oo. 

Alternatively,  if  r  >  2  (1  -  a),  let  r*  =  r  -  2  (1  -  a)  and  /?  =  1.  Then  again  via 
(4.3.14),  the  series  of  (4.3.4)  is  dominated  by  0(1)  Yj{Y^{\og^  l^il)^')  <  cx)  recalling 
(4.3.6).  The  theorem  follows  then  directly  from  Corollary  13.  □ 

To  illustrate  Theorem  5,  we  will  revoke  previous  examples  from  Chapters  2  and 
3. 

Example  6.  As  was  observed  in  Example  3  of  Chapter  2,  the  harmonic  series 

with  a  random  choice  of  signs  yields  the  tail  series  LIL  (2.4.14)  thereby  ensuring 

the  tail  series  SLLN 

i 
"'  XT^"  -^  0  *-s-  (^  >  0) 


12-+= 


(log2«)' 

obtains.    Alternatively,  the  same  conclusion  follows  directly  from  our  tail  series 
SLLN  (Theorem  5  with  t  =  0  and  a  =  |  —  e). 

Example  7.  The  same  argument  as  in  Example  6  can  be  applied  to  Example  5 
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of  Chapter  3,  i.e.,  since 

r  ~  (log2  "■T  (logs  ")"  and  logj  t^^  ~  logj  n 


na? 


(see  Rosalsky  [41,  Example  1]  for  verification),  the  condition  (4.3.5)  holds  with 
T  >  u  (or  T  =  u  if  u  <  0)  and  so  from  Theorem  5  the  tail  series  SLLN 

obtains  whenever  — oo  <  a  <  ^  provided  (4.3.6)  holds  if  r  >  2(1  —  a). 

In  the  following  example,  we  will  see  an  application  of  the  tail  series  SLLN  to 
the  field  of  time  series  analysis. 

Example  8.  Let  {St,  t  =  0,  it  1,  ±2,  ...}  be  the  moving  average  process  of 
infinite  order  given  by 

oo 

St  =  J2('J^t-J  (4.3.15) 

i=o 

where  {Xt,  t  =  0,  ±1,  ±2,  ...}  are  i.i.d.  normal  random  variables  with  mean  0 
and  variance  1  and  {aj,  j  >  0}  is  a  square  summable  sequence  of  constants.  As  a 
specific  example,  consider  a  long  memory  process,  which  is  represented  by  (4.3.15) 
with  Co  =  1  and 

T{j  +  d)  k-l  +  d 


Ui  = 


'   nj  +  \)T{d)   „^v<i    ^ 


n  — r-^'i>i  (4.3.16) 


where 


\d\  <  ]-  and  T{x)  =  < 


J  0 

t^-'e- 

'dt, 

if  I 

>0 

CX), 

ifx 

=  0 

.^'^ 

r(i  + 

^), 

if  X 

<0 

'  k  >•         «  .* 
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By  Stirling's  formula 

r(x)  ~  ^27^6-="+^  (x  -  If -2  asx-yoo 

.  ■■    ■.■-  ■-*  r- 

applied  to  (4.3.16),  we  obtain  (see  e.g.,  Brockwell  and  Davis  [11],  p.  466)  for  rf  ^  0         -< 


Then 


°°  1         °°  n 


2d-l 


ind)r^/       {i-2d)iT{d)y 


}=n  ■  ■      ■  '■ 


implying 


log2<;2  -log^n,  tl  =  0(tl^,),  and  ^  =  0(1). 


Thus  the  conditions  (4.2.22)  and  (4.3.5)  (with  r  =  0)  hold  and  so  for  every  integer 
t  and  all  a  G  (— oo,  |),  the  tail  series  SLLN 


n^-'^ 


follows  from  Theorem  5.  We  have  thus  determined  an  order  bound  on  the  almost 
sure  rate  in  which  YL^=o  Oj  ^t-j  converges  to  St  for  every  t.  Observe  that  this  rate  is 
independent  of  the  time  t.  Of  course,  I2j=o  °i  ^t-i  is  structurally  far  simpler  than 
St. 


CHAPTER  5 
SOME  FUTURE  RESEARCH  PROBLEMS 


The  current  research  work  suggests  a  number  of  open  problems  or  areas  for 
future  research  activity.  These  problems  or  areas  are  discussed  in  this  chapter. 

In  Chapter  2,  a  function  tl^{x)  in  a  specific  class  of  functions  ^  defined  by  Klesov 
[29  and  30]  was  employed  for  determining  the  norming  constants  for  tail  series 
SLLNs  for  random  variables.  Actually,  this  class  $  is  a  tail  series  partial  analogue 
of  the  class  ^c  defined  by  Petrov  [38]  as  follows;  a  function  /  belongs  to  $c  if  it 
is  a  positive  and  nondecreasing  function  such  that  the  series  ]C^i  „  //„\  converges. 
In  the  case  of  the  SLLNs  for  partial  sums,  Egorov  [21]  defined  a  wider  class  of 
functions  Fc  as  follows;  a  function  /  belongs  to  Fc  if  {/(x))'  €  ^c  for  some  e  >  0.  In 
the  same  spirit  as  in  Chapter  2,  tail  series  SLLNs  which  might  exist  and  correspond 
to  Egorov's  [21]  SLLNs  for  partial  sums  will  possibly  employ  a  function  in  a  class 
which  is  a  tail  series  analogue  of  Fc.  It  would  be  particularly  interesting  to  see 
whether  such  tail  series  SLLNs  subsumes  the  results  of  Chapter  2. 

In  the  Theorem  4  of  Chapter  4,  we  established  the  counterpart  to  the  SLLN  for 
partial  sums  of  Teicher  [47].  But  Theorem  4  is  indeed  an  incomplete  analogue  of 
the  SLLN  of  Teicher  [47]  because  we  assumed 
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for  all  e  >  0  rather  than  for  merely  some  e  >  0,  as  was  the  case  in  a  partial  sum 
version  of  condition  (5.0.3)  which  was  used  by  Teicher  [47]  to  prove  a  SLLN.  The 
reason  for  this  is  that  our  tail  series  exponential  bound  (part  (u)  of  Lemma  10  of 
Chapter  4),  which  is  employed  to  prove  Theorem  4  of  Chapter  4,  was  proved  only 
for  all  V  G  (0,  u~^]  rather  than  for  all  v  €  (0,  od).  Thus,  by  establishing  an  extension 
of  this  exponential  bound  lemma  without  the  restriction  on  v  (as  is  the  case  in  an 
exponential  bound  for  partial  sums),  the  assumption  (5.0.3)  for  all  £  >  0  might  be 
able  to  be  weakened  to  (5.0.3)  for  some  £  >  0.  Conceivably,  under  no  additional 
conditions  or  under  mild  conditions,  the  convergence  of  the  series  in  (5.0.3)  for  some 
£  >  0  guarantees  convergence  for  all  £  >  0  but  this  would  require  some  investigation. 
Next,  it  will  be  a  very  interesting  problem  to  establish  tail  series  analogues 
of  Adler  and  Rosalsky's  [3,  4]  general  SLLNs  for  weighted  sums  of  (stochastically 
dominated  or  i.i.d)  random  variables.  Adler  and  Rosalsky  [3]  established  general 
SLLNs  of  the  form 

On 

where  {Yn,  n  >  1}  are  stochastically  dominated  by  a  random  variable  |F|  and 
{Tju  n  >  1}  are  suitable  conditional  expectations  or  are  all  0.  In  their  follow- 
up  paper,  Adler  and  Rosalsky  [4]  provided  sets  of  necessary  and  (or)  sufficient 
conditions  for  {a„  V^,  n  >  1}  to  obey  the  general  SLLN  of  the  form 

— ''— >  0  a.s. 

On 

where  {Yn,  n  >  1}  is  a  sequence  of  i.i.d.  mean  0  random  variables  and  {a„,  n  >  1} 
are  nonzero  constants. 
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Finally,  tail  series  problems  for  almost  surely  convergent  series  of  independent 
random  elements  taking  values  in  normed  linear  spaces  is  an  area  ripe  for  extensive 
research  activity.  Beginning  with  the  pioneering  work  of  Mourier  [36]  (wherein  an 
analogue  of  the  classical  Kolmogorov  SLLN  was  proved  for  sums  of  i.i.d.  random 
elements  taking  values  in  a  real  separable  Banach  space),  an  extensive  literature 
of  investigation  has  appeared  on  the  SLLN  and  WLLN  problems  for  partial  sums 
of  Banach  space  Vcilued  random  elements.  For  some  recent  developments  in  this 
general  direction,  see  the  articles  Adler,  Rosalsky,  and  Taylor  [5,  6,  7]  and  some 
of  the  references  contained  therein  (specifically,  see  Beck  [10],  Ito  and  Nisio  [26], 
H0fFmann-Jorgensen  and  Pisier  [25],  Woyczynski  [51,  52],  Kuelbs  and  Zinn  [33],  de 
Acosta  [2],  and  Wang  and  Bhaskara  Rao  [49]).  The  necessary  background  material 
for  reading  the  above  papers  on  Banach  space  valued  random  elements  may  be  found 
in  Taylor  [44].  Tail  series  versions  of  some  of  the  results  in  the  literature  cited  above 
would  certainly  be  a  worthwhile  research  accomplishment.  Indeed,  the  very  question 
as  to  when  a  series  of  independent  Banach  space  valued  random  elements  converges 
almost  surely  is  one  which  requires  more  investigation.  For  some  results  in  this 
direction,  see  Hoffmann- J0rgensen  [24],  Jain  [27],  and  Woyczynski  [51,  p.  386-390 
and  p.  430-431]. 
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